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Chapter 1 


Introduction 


This document describes new vector instructions for the Intel® Xeon Phi” coprocessor. 


The major features of the new vector instructions described herein are: 


A high performance 64 bit execution environment The Intel® Xeon Phi” coprocessor provides a 64 bit ex- 
ecution environment (see Figure 2.1) similar to that found in the Intel64® Intel® Architecture Software 
Developer's Manual. Additionally, Intel® Xeon Phi” Coprocessor Instruction Set Architecture provides basic 
support for float64 and int64 logical operations. 


32 new vector registers The Intel® Xeon Phi” coprocessor's 64 bit environment offers 32 512-bit wide vector 
SIMD registers tailored to boost the performance of high performance computing applications. The 512- 
bit vector SIMD instruction extensions provide comprehensive, native support to handle 32 bit and 64 bit 
floating-point and integer data, including a rich set of conversions for native data types. 


Ternary instructions Most instructions are ternary, with two sources and a different destination. Multi- 
ply&add instructions are ternary with three sources, one of which is also the destination. 


Vector mask support Intel® Xeon Phi” Coprocessor Instruction Set Architecture introduces 8 vector mask regis- 
ters that allow for conditional execution over the 16 (or 8) elements in a vector instruction, and merging of 
the results into the destination. Masks allow vectorizing loops that contain conditional statements. Addi- 
tionally, Intel® Xeon Phi" Coprocessor Instruction Set Architecture provides support for updating the value 
of the vector masks with special vector instructions such as vempmps. 


Coherent memory model The Intel® Xeon Phi” Coprocessor Instruction Set Architecture operates in a memory 
address space that follows the standard defined by the Intel® 64 achitecture. This feature eases the process 
of developing vector code. 


Gather/Scatter support The /ntel® Xeon Phi” Coprocessor Instruction Set Architecture features specific gather/scatter 
instructions that allow manipulation of irregular data patterns of memory (by fetching sparse locations of 
memory into a dense vector register or vice-versa) thus enabling vectorization of algorithms with complex 
data structures. 
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Chapter 2 


Instructions Terminology and State 


The vector streaming SIMD instruction extensions are designed to enhance the performance of Intel® 64 pro- 
cessors for scientific and engineering applications. 


This chapter introduces Intel® Xeon Phi” Coprocessor Instruction Set Architecture terminology and relevant pro- 
cessor state. 


2.1 Overview of the Intel’ Xeon Phi Coprocessor Instruction Set Archi- 
tecture Extensions 


2.1.1. What are vectors? 


The vector is the basic working unit of the Intel® Xeon Phi” Coprocessor Instruction Set Architecture. Most instruc- 
tions use at least one vector. A vector is defined as a sequence of packed data elements. For Intel® Xeon Phi” Co- 
processor Instruction Set Architecture the size of a vector is 64 bytes. As the support data types are float32, int32, 
float64 and int64, then a vector consists on either 16 doubleword-size elements or alternatively, 8 quadword- 
size elements. Only doubleword and quadword elements are supported in Intel® Xeon Phi” Coprocessor Instruc- 
tion Set Architecture. 


The number of Intel® Xeon Phi” Coprocessor Instruction Set Architecture registers is 32. 


Additionally, Intel® Xeon Phi” Coprocessor Instruction Set Architecture features vector masks. Vector masks allow 
any set of elements in the destination to be protected from updates during the execution of any operation. A 
subset of this functionality is the ability to control the vector length of the operation being performed (that is, 
the span of elements being modified, from the first to the last one); however, it is not necessary that the elements 
that are modified be consecutive. 


2.1.2 Vector mask registers 


Most Intel® Xeon Phi” Coprocessor Instruction Set Architecture vector instructions use a special extra source, 
known as the write-mask, sourced from a set of 8 registers called vector mask registers. These registers contain 
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one bit for each element that can be held by a regular Intel® Xeon Phi” Coprocessor Instruction Set Architecture 
vector register. 


Elements are always either float32, int32, float64 or int64 and the vector size is set to 64 bytes. Therefore, a 
vector register holds either 8 or 16 elements; accordingly, the length of a vector mask register is 16 bits. For 64 
bit datatype instructions, only the 8 least significant bits of the vector mask register are used. 


A vector mask register affects an instruction for which it is the write-mask operand at element granularity (either 
32 or 64 bits). That means that every element-sized operation and element-sized destination update by a vector 
instruction is predicated on the corresponding bit of the vector mask register used as the write-mask operand. 
That has two implications: 


¢ The instruction's operation is not performed for an element if the corresponding write-mask bit is not 
set. This implies that no exception or violation can be caused by an operation on a masked-off element. 


¢ A destination element is not updated if the corresponding write-mask bit is not set. Thus, the mask 
in effect provides a merging behavior for Intel® Xeon Phi” Coprocessor Instruction Set Architecture vector 
register destinations, thereby potentially converting destinations into implicit sources, whenever a write- 
mask containing any 0-bits is used. 


This merging behavior, and the associated performance hazards, can also occur when writing a vector to 
memory via a vector store. Vectors are written on a per element basis, based on the vector mask regis- 
ter used as a write-mask. Therefore, no exception or violation can be caused by a write to a masked-off 
element of a destination vector operand. 


The sticky bits implemented in the MXCSR to indicate that floating-point exceptions occurred, are set based 
soley upon operations on non-masked vector elements. 


The value of a given mask register can be set up as a direct result of a vector comparison instruction, transferred 
from a GP register, or calculated as a direct result of a logical operation between two masks. 


Vector mask registers can be used for purposes other than write-masking. For example, they can be used to to 
set the EFLAGS based on the 0/0xFFFF /other status of the OR of two vector mask registers. A number of the 
Intel® Xeon Phi" Coprocessor Instruction Set Architecture are provided to support such uses of the vector mask 
register. 


2.1.2.1 Vector mask k0 


The only exception to the vector mask rules described above is mask k0. Mask k0 cannot be selected as the write- 
mask for a vector operation; the encoding that would be expected to select mask 0 instead selects an implicit 
mask of OxFFFF, thereby effectively disabling masking. Vector mask k0 can still be used as any non-write-mask 
operand for any instruction that takes vector mask operands; it just can't ever be selected as a write-mask. 


2.1.2.2 Example of use 


Here's an example of a masked vector operation. 
The initial state of vector registers zmm0, zmm1, and zmm2 is: 


MSB LSB 
zmm0 = [ 0x00000003 0x00000002 0x00000001 0x00000000 J (bytes 15 through 0) 
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[ 0x00000007 0x00000006 0x00000005 0x00000004 ] (bytes 31 through 16) 
[ 0x0000000B 0x0000000A 0x00000009 0x00000008 J (bytes 47 through 32) 
[ O0x0000000F 0x0000000E 0x0000000D 0x0000000C ] (bytes 63 through 48) 
zmm1 = [ OxO0000000F OxO0000000F 0x0000000F Ox0000000F J (bytes 15 through 0) 
[ OxO000000F Ox0000000F 0x0000000F Ox0000000F J (bytes 31 through 16) 
[ Ox0000000F Ox0000000F 0x0000000F Ox0000000F J (bytes 47 through 32) 
[ OxO000000F Ox0000000F 0x0000000F Ox0000000F J (bytes 63 through 48) 
zmm2 = [ OxAAAAAAAA OxAAAAAAAA OxAAAAAAAA OxAAAAAAAA ] (bytes 15 through 0) 
[ OxBBBBBBBB OxBBBBBBBB OxBBBBBBBB OxBBBBBBBB ] (bytes 31 through 16) 
[ OxCCCCCCCC OxCCCCCCCC OxCCCCCCCC OxCCCCCCCC ] (bytes 47 through 32) 
[ OxDDDDDDDD OxDDDDDDDD OxDDDDDDDD OxDDDDDDDD J (bytes 63 through 48) 
k3 = Ox8F03 (1000 1111 0000 0011) 


Given this state, we will execute the following instruction: 


vpaddd zmm2 {k3}, zmmO, zmm1 


The vpaddd instruction adds vector elements of 32 bit integers. Since elements are not operated upon when the 
corresponding bit of the mask is not set, the temporary result would be: 


[ DR OK ee KKK 2K OK 2K OK OK OK OK OK 
[ DK OK ee a KKK 2K OK OK 2K OK OK OK OK 


0x00000010 Ox0000000F ] 
FORK RIK: J] 


[ 0x0000001A 0x00000019 0x00000018 0x00000017 ] 


[ OxOO00001E ***#KKKKK 


FR OK OK OK A A A KK OK OK OK OK OK KK ] 


where "*********4" indicates that no operation is performed. 


(bytes 15 through 0) 
(bytes 31 through 16) 
(bytes 47 through 32) 
(bytes 63 through 48) 


This temporary result is then written into the destination vector register, zmm2, using vector mask register k3 
as the write-mask, producing the following final result: 


zmm2 = [ OxAAAAAAAA OxAAAAAAAA 0x00000010 Ox0000000F J 
[ OxBBBBBBBB OxBBBBBBBB OxBBBBBBBB OxBBBBBBBB ] 
[ 0x0000001A 0x00000019 0x00000018 0x00000017 ] 
[ 0x0000001E OxDDDDDDDD OxDDDDDDDD OxDDDDDDDD J 


(bytes 15 through 0) 
(bytes 31 through 16) 
(bytes 47 through 32) 
(bytes 63 through 48) 


Note that for a 64 bit instruction (say vaddpd), only the 8 LSB of mask k3 (0x03) would be used to identify the 
write-mask operation on each one of the 8 elements of the source/destination vectors. 


2.1.3 Understanding Intel’ Xeon Phi Coprocessor Instruction Set Architecture 


Intel® Xeon Phi” Coprocessor Instruction Set Architecture can be classified depending on the nature of their 
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operands. The majority of the Intel® Xeon Phi” Coprocessor Instruction Set Architecture operate on vector regis- 
ters, with a vector mask register serving as a write-mask. However, in most cases these instructions may have 
one of the vector source operands stored in either memory or a vector register, and may additionally have one 
or more non-vector (scalar) operands, such as a Intel® 64 general purpose register or an immediate value. Ad- 
ditionally, some instructions use vector mask registers as destinations and/or explicit sources. Finally, Intel® 
Xeon Phi” Coprocessor Instruction Set Architecture adds some new scalar instructions. 


From the point of view of instruction formats, there are four main types of Intel® Xeon Phi” Coprocessor Instruc- 
tion Set Architecture: 


e Vector Instructions 


e Vector Memory Instructions 


Vector Mask Instructions 


e New Scalar Instructions 


2.1.3.1 Intel Xeon Phi’ Coprocessor Instruction Set Architecture Vector Instructions 


Vector instructions operate on vectors that are sourced from either registers or memory and that can be modified 
prior to the operation via predefined swizzle and convert functions. The destination is usually a vector register, 
though some vector instructions may have a vector mask register as either a second destination or the primary 
destination. 


All these instructions work in an element-wise manner: the first element of the first source vector is operated 
on together with the first element of the second source vector, and the result is stored in the first element of the 
destination vector, and so on for the remaining 15 (or 7) elements. 


As described above, the vector mask() register that serves as the write-mask for a vector instruction determines 
which element locations are actually operated upon; the mask can disable the operation and update for any 
combination of element locations. 


Most vector instructions have three different vector operands (typically, two sources and one destination) ex- 
cept those instructions that have a single source and thus use only two operands. Additionally, most vector 
instructions feature an extra operand in the form of the vector mask() register that serves as the write-mask. 
Thus, we can categorize Intel® Xeon Phi” Coprocessor Instruction Set Architecture vector instructions based on 
the number of vector sources they use: 


Vector-Converted Vector/Memory. Vector-converted vector/memory instructions, such as vaddps (which 
adds two vectors), are ternary operations that take two different sources, a vector register and a converted 
vector/memory operand, and a separate destination vector register, as follows: 


zmmO <= OP(zmmi, S(zmm2, m)) 


where zmm_1 is a vector operand that is used as the first source for the instruction, S(zmm2, m) is a con- 
verted vector/memory operand that is used as the second source for the instruction, and the result of 
performing operation OP on the two source operands is written to vector destination register zmm0. 


A converted vector/memory operand is a source vector operand that it is obtained through the process of 
applying a swizzle/conversion function to either a Intel® Xeon Phi” Coprocessor Instruction Set Architecture 
vector or a memory operand. The details of the swizzle/conversion function are found in section 2.2; 
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note that its behavior varies depending on whether the operand is a register or a memory location, and, 
for memory operands, on whether the instruction performs a floating-point or integer operation. Each 
source memory operand must have an address that is aligned to the number of bytes of memory actually 
accessed by the operand (that is, before the swizzle/convert is performed); otherwise, a #GP fault will 
result. 


Converted Vector/Memory. Converted vector/memory instructions, such as vcvtpu2ps (which converts a vec- 
tor of unsigned integers to a vector of floats), are binary operations that take a single vector source, as 
follows: 


zmmO <= OP(S(zmmi, m)) 


Vector-Vector-Converted Vector/Memory. Vector-vector-converted vector/memory instructions, of which 
vfmadd*ps (multiply-add of three vectors) is a good example, are similar to the vector-converted vec- 
tor/memory family of instructions; here, however, the destination vector register is used as a third source 
as well: 


zmmO <= OP(zmm0O, zmmi, S(zmm2, m)) 


2.1.3.2 Intel Xeon Phi Coprocessor Instruction Set Architecture Vector Memory Instructions: 


Vector Memory Instructions perform vector loads from and vector stores to memory, with extended conversion 
support. 


As with regular vector instructions, vector memory instructions transfer data from/to memory in an element- 
wise fashion, with the elements that are actually transferred dictated by the contents of the vector mask that is 
selected as the write-mask. 


There are two basic groups of Intel® Xeon Phi" Coprocessor Instruction Set Architecture vector memory instruc- 
tions, vector loads/broadcasts and vector stores. 


Vector Loads/Broadcasts. A vector load/broadcast reads a memory source, performs a predefined load con- 
version function, and replicates the result (in the case of broadcasts) to form a 64-byte 16-element vector 
(or 8-element for 64 bit datatypes). This vector is then conditionally written element-wise to the vector 
destination register, with the writes enabled or disabled according to the corresponding bits of the vector 
mask register selected as the write-mask. 


The size of the memory operand is a function of the type of conversion and the number of replications 
to be performed on the memory operand. We call this special memory operand an up-converted memory 
operand. Each source memory operand must have an address that is aligned to the number of bytes of 
memory actually accessed by the operand (that is, before the swizzle/convert is performed); otherwise, a 
#GP fault will result. 


A Vector Load operates as follows: 
zmm0 <= U(m) 


where U(m) isan up-converted memory operand whose contents are replicated and written to destination 
register zmm0. The mnemonic dictates the degree of replication and the conversion table. 
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A special sub-case of these instructions are Vector Gathers. Vector Gathers are a special form of vector 
loads where, instead of a consecutive chunks of memory, we load a sparse set of memory operands (as 
many as the vector elements of the destination). Every one of those memory operands must obey the 
alignment rules; otherwise, a #GP fault will result if the related write-mask bit is not disabled (set to 0). 


A Vector Gather operates as follows: 
zmmO <= U(mv) 


where U(mv) is a set of up-converted memory operands described by a base address, a vector of indices 
and an immediate scale to apply for each index. Every one of those operands is conditionally written to 
destination vector zmm0 (based on the value of the write-mask). 


Vector Stores. A vector store reads a vector register source, performs a predefined store conversion function, 
and writes the result to the destination memory location on a per-element basis, with the writes enabled 
or disabled according to the corresponding bits of the vector mask register selected as the write-mask. 


The size of the memory destination is a function of the type of conversion associated with the mnemonic. 
We call this special memory operand a down-converted memory operand. Each memory destination 
operand must have an address that is aligned to the number of bytes of memory accessed by the operand 
(pre-conversion, if conversion is performed); otherwise, a #GP fault will result. 


A Vector Store operates as follows: 
m <= D(zmm0) 


where zmm0 is the vector register source whose full contents are down-converted (denoted by D()), and 
written to memory. 


A special sub-case of these instructions are Vector Scatters. Vector Scatters are a special form of vector 
stores where, instead of writing the source vector into a consecutive chuck of memory, we store each 
vector element into a different memory location. Every one of those memory destinations must obey the 
alignment rules; otherwise, a #GP fault will result if the related write-mask bit is not disabled (set to 0). 


A Vector Scatter operates as follows: 
mv <= D(zmm0) 


where zmm20 is the vector register source whose full or partial contents are down-converted (denoted 
by D()), and written to the set of memory locations mv, specified by a base address, a vector of indices 
and an immediate scale which is applied to every index. Every one of those down-converted elements are 
conditionally stored in the memory locations based on the value of the write-mask. 


2.1.3.3 Intel Xeon Phi Coprocessor Instruction Set Architecture vector mask Instructions 


Vector mask instructions allow programmers to set, copy, or operate on the contents of a given vector mask. 


There are three types of vector mask instructions: 


¢ Mask read/write instructions: These instruction move data between a general-purpose integer register 
and a vector mask register, or between two vector mask registers. 
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¢ Flag instructions: This category, consisting of instructions that modify EFLAGS based on vector mask 
registers, actually contains only one instruction, kortest. 


¢ Mask logical instructions: These instructions perform standard bitwise logical operations between vec- 
tor mask registers. 


2.1.3.4 Intel Xeon Phi Coprocessor Instruction Set Architecture New Scalar Instructions 


In addition to vector, vector memory, and vector mask instructions, Intel® Xeon Phi” Coprocessor Instruction Set 
Architecture adds a few scalar instructions as well. These instructions are useful for increasing the performance 
of some critical algorithms; for example, any code that suffers reduced performance due to cache-miss latency 
can benefit from the new prefetch instructions. 


2.2 Intel Xeon Phi Coprocessor Instruction Set Architecture Swizzles 
and Converts 


Data transformation, in the form of certain data conversions or element rearrangements (for loads, both at once) 
of one operand, can be performed for free as part of most Intel® Xeon Phi” Coprocessor Instruction Set Architec- 
ture vector instructions. 


Three sorts of data transformations are available: 
¢ Data Conversions: Sources from memory can be converted to either 32 bit signed or unsigned integer or 


32 bit floating-point before being used. Supported data types in memory are float16, sint8, uint8, sint16, 
and uint16 for load-op instructions 


Broadcast: If the source memory operand contains fewer than the total number of elements, it can be 
broadcast (repeated) to form the full number of elements of the effective source operand (16 for 32 bit 
instructions, 8 for 64 bit instructions). Broadcast can be combined with load-type conversions only; load- 
op instructions can do one or the other: either broadcast, or swizzle and/or up-conversion. There are two 
broadcast granularities: 


- 1-element granularity where the 1 element of the source memory operand are broadcast 16 times 
to form a full 16-element effective source operand (for 32 bit instructions), or 8 times to form a full 
8-element effective source operand (for 64 bit instructions). 


- 4-element granularity where the 4 elements of the source memory operand is broadcast 4 times 
to form a full 16-element effective source operand (for 32 bit instructions), or 2 times to form a full 
8-element effective source operand (for 64 bit instructions). 


Broadcast is very useful for instructions that mix vector and scalar sources, where one of the sources is 
common across the different operations. 


Swizzles: Sources from registers can undergo swizzle transformations (that is, they can be permuted), 
although only 8 swizzles are available, all of which are limited to permuting within 4-element sets (either 
of 32 bits or 64 bits each). 


Intel® Xeon Phi” Coprocessor Instruction Set Architecture also introduces the concept of Rounding Mode Over- 
ride or Static (per instruction) Rounding Mode, which efficiently supports the feature of determining the 
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rounding mode for arithmetic operations on a per-instruction basis. Thus one can choose the rounding mode 
without having to perform costly MXCSR save-modify-restore operations. 


The Intel® Xeon Phi” coprocessor extends the swizzle functionality for register-register operands in order to 
provide rounding mode override capabilities for the Intel® Xeon Phi” coprocessor floating-point instructions 
instead of obeying the MXCSR.RC bits. All four rounding modes are available via swizzle attribute: Round- 
up, Round-down, Round-toward-zero and Round-to-nearest. The option is not available for instructions with 
memory operands. On top of these options, the Intel® Xeon Phi” coprocessor introduces the SAE (suppress- 
all-exceptions) attribute feature. An instruction with SAE set will not raise any kind of floating-point exception 
flags, independent of the inputs. 


In addition to those transformations, all Intel® Xeon Phi” Coprocessor Instruction Set Architecture memory 
operands may have a special attribute, called the FH hint (eviction hint), that indicates to the processor that 
the data is non-temporal - that is, it is unlikely to be reused soon enough to benefit from caching in the 1st-level 
cache and should be given priority for eviction. This is, however, a hint, and the processor may implement it in 
any way it chooses, including ignoring the hint entirely. 


Table 2.1 shows the assembly language syntax used to indicate the presence or absence of the EH hint. 


B1 Function Usage Comment 

0 [eax] (no effect) regular memory operand 

1 EH [eax] {eh} memory operand with Non-Temporal (Evic- 
tion) hint 


Table 2.1: EH attribute syntax. 


Data transformations can only be performed on one source operand at most; for instructions that take two 
or three source operands, the other operands are always used unmodified, exactly as they're stored in their 
source registers. In no case do any of the Intel® Xeon Phi” Coprocessor Instruction Set Architecture allow using 
data conversion and swizzling at the same time. Broadcasts, on the other hand, can be combined with data 
conversions when performing vector loads. 


Not all instructions can use all of the different data transformations. Load-op instructions (such as vector arith- 
metic instructions), vector loads, and vector stores have different data transformation capabilities. We can cat- 
egorize these transformation capabilities into three families: 


¢ Load-Op SwizzUpConv: For a register source, swizzle; fora memory operand, either: (a) broadcast, or (b) 
convert to 32 bit floats or 32 bit signed or unsigned integers. This is used by vector arithmetic instructions 
and other load-op instructions. There are two versions, one for 32 bit floating-point instructions and 
another for 32 bit integer instructions; in addition, the available data transformations differ for register 
and memory operands. 


¢ Load UpConv: Convert from a memory operand to 32 bit floats or 32 bit signed or unsigned integers; used 
by vector loads and broadcast instructions. For 32 bit floats, there are three different conversion tables 
based on three different input types. See Section 2.2.2, Load UpConvert. 
There is no load conversion support for 64 bit datatypes. 


¢ DownConv: Convert from 32 bit floats or 32 bit signed or unsigned integers to a memory operand; used by 
vector stores. For 32 bit floats, there are three different conversion tables based on three different output 
types. See Section 2.2.3, Down-Conversion. 
There is no store conversion support for 64 bit datatypes. 
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2.2.1 lLoad-Op Swizzle/Convert 


Vector load-op instructions can swizzle, broadcast, or convert one of the sources; we will refer to this as the 
swizzle/convert source, and we will use SwizzUpConv to describe the swizzle/convert function itself. The avail- 
able SwizzUpConv transformations vary depending on whether the operand is memory or a register, and also 
in the case of conversions from memory depending on whether the vector instruction is 32 bit integer, 32 bit 
floating-point, 64 bit integer or 64 bit floating-point. 3 bits are used to select among the different options, so 
eight options are available in each case. 


When the swizzle/convert source is a register, SwizzUpConv allows the choice of one of eight swizzle primitives 
(one of the eight being the identity swizzle). These swizzle functions work on either 4-byte or 8-byte elements 
within 16-byte/32-byte boundaries. For 32 bit instructions, that means certain permutations of each set of four 
elements (16 bytes) are supported, replicated across the four sets of four elements. When the swizzle/convert 
source is a register, the functionality is the same for both integer and floating-point 32 bit instructions. Table 2.2 
shows the available register-source swizzle primitives. 


S9S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element across 4-element packets | zmm0 {aaaa} 

101 broadcast b element across 4-element packets | zmm0 {bbbb} 

110 broadcast c element across 4-element packets | zmm0 {cccc} 

111 broadcast d element across 4-element packets | zmm0 {dddd} 


Table 2.2: 32 bit Register SwizzUpConv swizzle primitives. Notation: dcba denotes the 32 bit elements that 
form one 128-bit block in the source (with ‘a’ least significant and 'd' most significant), so aaaa means that the 
least significant element of the 128-bit block in the source is replicated to all four elements of the same 128- 
bit block in the destination; the depicted pattern is then repeated for all four 128-bit blocks in the source and 
destination. We use 'ponm lkji hgfe dcba' to denote a full Intel® Xeon Phi” Coprocessor Instruction Set Architecture 
source register, where 'a' is the least significant element and 'p' is the most significant element. However, since 
each 128-bit block performs the same permutation for register swizzles, we only show the least significant block 
here. Note that in this table as well as in subsequent ones from this chapter S25; So are bits 6-4 from MVEX prefix 
encoding (see Figure 3.3 


For 64 bit instructions, that means certain permutations of each set of four elements (32 bytes) are supported, 
replicated across the two sets of four elements. When the swizzle/convert source is a register, the functionality 
is the same for both integer and floating-point 64 bit instructions. Table 2.3 shows the available register-source 
swizzle primitives. 


When the source is a memory location, load-op swizzle/convert can perform either no transformation, 2 differ- 
ent broadcasts, or four data conversions. Vector load-op instructions cannot both broadcast and perform data 
conversion at the same time. The conversions available differ depending on whether the associated vector in- 
struction is integer or floating-point, and whether the natural data type is 32 bit or 64 bit. (Note however that 
there are no load conversions for 64 bit destination data types.) 


Source memory operands may have sizes smaller than 64 bytes, expanding to the full 64 bytes of a vector source 
by means of either broadcasting (replication) or data conversion. 


Each source memory operand must have an address that is aligned to the number of bytes of memory actually 
accessed by the operand (thatis, before conversion or broadcastis performed); otherwise, a #GP fault will result. 
Thus, for SwizzUpConv, any of 4-byte, 16-byte, 32-byte, or 64-byte alignment may be required. 
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S9S1Spo || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element across 4-element packets | zmm0 {aaaa} 

101 broadcast b element across 4-element packets | zmm0 {bbbb} 

110 broadcast c element across 4-element packets | zmm0 {cccc} 

111 broadcast d element across 4-element packets | zmm0 {dddd} 


Table 2.3: 64 bit Register SwizzUpConv swizzle primitives. Notation: dcba denotes the 64 bit elements that 
form one 256-bit block in the source (with ‘a’ least significant and 'd' most significant), so aaaa means that the 
least significant element of the 256-bit block in the source is replicated to all four elements of the same 256- 
bit block in the destination; the depicted pattern is then repeated for the two 256-bit blocks in the source and 
destination. We use 'hgfe dcba' to denote a full Intel® Xeon Phi” Coprocessor Instruction Set Architecture source 
register, where 'a' is the least significant element and 'h' is the most significant element. However, since each 
256-bit block performs the same permutation for register swizzles, we only show the least significant block here. 


S251Spo || Function: Usage 

000 no conversion [rax] 

001 broadcast 1 element (x16) | [rax] {1to16} 
010 broadcast 4 elements (x4) | [rax] {4to16} 
011 float16 to float32 [rax] {float16} 
100 uint8 to float32 [rax] {uint8} 
101 reserved N/A 

110 uint16 to float32 [rax] {uint16} 
111 sint16 to float32 [rax] {sint16 } 


Table 2.4: 32 bit Floating-point Load-op SwizzUpConv ;32 swizzle/conversion primitives. We use 'ponm lkji 
hgfe dcba' to denote a full Intel® Xeon Phi” Coprocessor Instruction Set Architecture source register, with each 
letter referring to a 32 bit element, where ‘a’ is the least significant element and 'p' is the most significant el- 
ement. So, for example, 'dcba dcba dcba dcba' shows that the source elements are copied to the destination 
by replicating the lower 128 bits of the source (the four least significant elements) to each 128-bit block of the 
destination. 

Table 2.4 shows the available 32 bit floating-point swizzle primitives. 

SwizzUpConv conversions to float32s are exact. 

Table 2.5 shows the available 32 bit integer swizzle primitives. 


Table 2.6 shows the available 64 bit floating-point swizzle primitives. 


Finally, Table 2.7 shows the available 64 bit integer swizzle primitives. 


2.2.2 Load Up-convert 


Vector load/broadcast instructions can perform a wide array of data conversions on the data being read from 
memory, and can additionally broadcast (replicate) that data across the elements of the destination vector reg- 
ister depending on the instructions. The type of broadcast depends on the opcode/mnemonic being used. We 


30 Reference Number: 327364-001 


= 
2. 


CHAPTER 2. INSTRUCTIONS TERMINOLOGY AND STATE 


S'9$1Spo || Function: Usage 

000 no conversion [rax] {16to16} or [rax] 
001 broadcast 1 element (x16) | [rax] {1to16} 

010 broadcast 4 elements (x4) | [rax] {4to16} 

011 reserved N/A 

100 uint8 to uint32 [rax] {uint8} 

101 sint8 to sint32 [rax] {sint8} 

110 uint16 to uint32 [rax] {uint16} 

111 sint16 to sint32 [rax] {sint16 } 


Table 2.5: 32 bit Integer Load-op SwizzUpConv;3. (Doubleword) swizzle/conversion primitives. We use 
‘ponm Ikji hgfe dcba' to denote a full Intel® Xeon Phi” Coprocessor Instruction Set Architecture source register, 
with each letter referring to a 32 bit element, where ‘a’ is the least significant element and 'p' is the most signif- 
icant element. So, for example, 'dcba dcba dcba dcba' shows that the source elements are copied to the destina- 
tion by replicating the lower 128 bits of the source (the four least significant elements) to each 128-bit block of 
the destination. 


$'9$1Spo || Function: Usage 


000 no conversion [rax] {8to8} or [rax] 
001 broadcast 1 element (x8) [rax] {1to8} 

010 broadcast 4 elements (x2) | [rax] {4to8} 

011 reserved N/A 

100 reserved N/A 

101 reserved N/A 

110 reserved N/A 

111 reserved N/A 


Table 2.6: 64 bit Floating-point Load-op SwizzUpConv «4 swizzle/conversion primitives. We use 'hgfe dcba' 
to denote a full Intel® Xeon Phi” Coprocessor Instruction Set Architecture source register, with each letter referring 
to a 64 bit element, where 'a' is the least significant element and ‘h' is the most significant element. So, for 
example, 'dcba dcba’' shows that the source elements are copied to the destination by replicating the lower 256 
bits of the source (the four least significant elements) to each 256-bit block of the destination. 


S'9$1Spo || Function: Usage 


000 no conversion [rax] {8to8} or [rax] 
001 broadcast 1 element (x8) [rax] {1to8} 

010 broadcast 4 elements (x2) | [rax] {4to8} 

011 reserved N/A 

100 reserved N/A 

101 reserved N/A 

110 reserved N/A 

111 reserved N/A 


Table 2.7: 64 bit Integer Load-op SwizzUpConv;,¢4 (Quadword) swizzle/conversion primitives. We use 'hgfe 
dcba' to denote a full Intel® Xeon Phi” Coprocessor Instruction Set Architecture source register, with each letter 
referring to a 64 bit element, where ‘a’ is the least significant element and 'h' is the most significant element. So, 
for example, 'dcba dcba' shows that the source elements are copied to the destination by replicating the lower 
256 bits of the source (the four least significant elements) to each 256-bit block of the destination. 


will refer to this conversion process as up-conversion, and we will use UpConv to describe the load conversion 
function itself. 
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Based on that, load instructions could be divided into the following categories: 


¢ regular loads: load 16 elements (32 bits) or 8 elements (64 bits), convert them and write into the destina- 
tion vector 


¢ broadcast 4-elements: load 4 elements, convert them (possible only for 32 bit data types), replicate them 
four times (32 bits) or two times (64 bits) and write into the destination vector 


¢ broadcast 1-element: load 1 element, convert it (possible only for 32 bit data types), replicate it 16 times 
(32 bits) or 8 times (64 bits) and write into the destination vector 


Therefore, unlike load-op swizzle/conversion, Load UpConv can perform both data conversion and broadcast 
simultaneously. We will refer to this process as up-conversion, and we will use Load UpConv to describe the load 
conversion function itself. 


When a broadcast 1-element is selected, the memory data, after data conversion, has a size of 4 bytes, and is 
broadcast 16 times across all 16 elements of the destination vector register. In other words, one vector element 
is fetched from memory, converted to a 32 bit float or integer, and replicated to all 16 elements of the destination 
register. Using the notation where the contents of the source register are denoted {ponm lkji hgfe dcba}, with 
each letter referring to a 32 bit element (‘a' being the least significant element and 'p' being the most significant 
element), the source elements map to the destination register as follows: 


{aaaa aaaa aaaa aaaa} 


When broadcast 4-element is selected, the memory data, after data conversion, has a size of 16 bytes, and is 
broadcast 4 times across the four 128-bit sets of the destination vector register. In other words, four vector 
elements are fetched from memory, converted to four 32 bit floats or integers, and replicated to all four 4-element 
sets in the destination register. For this broadcast, the source elements map to the destination register as follows: 


{dcba dcba dcba dcba} 
Table 2.8 shows the different 32 bit Load up-conversion instructions in function of the broadcast function and 


the conversion datatype. Similarly, Table 2.10 shows the different 64 bit Load up-conversion instructions in 
function of the broadcast function and datatype. 


Datatype Load (16-element) Broadcast 4-element Broadcast 1-element 
INT32 (d) VMOVDQA32 VBROADCASTI32X4 VPBROADCASTD 
FP32 (ps) VMOVAPS VBROADCASTF32X4 VBROADCASTSS 


Table 2.8: 32 bit Load UpConv load/broadcast instructions per datatype. Elements may be 1, 2, or 4 bytes in 
memory prior to data conversion, after which they are always 4 bytes. We use 'ponm lIkji hgfe dcba' to denote a 
full Intel® Xeon Phi” Coprocessor Instruction Set Architecture source register, with each letter referring to a 32 bit 
element, where ‘a’ is the least significant element and 'p' is the most significant element. So, for example, 'dcba 
dcba dcba dcba' shows that the source elements are copied to the destination by replicating the lower 128 bits 
of the source (the four least significant elements) to each 128-bit block of the destination. 


As with SwizzUpConv, UpConv may have source memory operands with sizes smaller than 64-bytes, which are 
expanded to a full 64-byte vector by means of broadcast and/or data conversion. Each source memory operand 
must have an address that is aligned to the number of bytes of memory actually accessed by the operand (that 
is, before conversion or broadcast is performed); otherwise, a #GP fault will result. Thus, any of 1-byte, 2-byte, 
4-byte, 8-byte, 16-byte, 32-byte, or 64-byte alignment may be required. 
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UpConvj32 (INT32) 


S551Spo || Function: Usage 

000 no conversion [rax] 

001 reserved N/A 

010 reserved N/A 

011 reserved N/A 

100 uint8 to uint32 [rax] {uint8} 
101 sint8 to sint32 [rax] {sint8} 
110 uint16 to uint32 [rax] {uint16} 
111 sint16 to sint32 [rax] {sint16 } 


UpConv 32 (FP32) 


S559 || Function: Usage 

000 no conversion [rax] 

001 reserved N/A 

010 reserved N/A 

011 float16 to float32 [rax] {float16} 

100 uint8 to float32 [rax] {uint8} 

101 sint8 to float32 [rax] {sint8} 

110 uint16 to float32 [rax] {uint16} 

111 sint16 to float32 [rax] {sint16 } 

Table 2.9: 32 bit Load UpConv conversion primitives. 

Datatype Load Broadcast 4-element Broadcast 1-element 
INT64 (q) VMOVDQA64 VBROADCASTI64X4 VPBROADCASTQ 
FP64 (pd) VMOVAPD VBROADCASTF64X4 VBROADCASTSD 


Table 2.10: 64 bit Load UpConv load/broadcast instructions per datatype. Elements are always 8 bytes. We 
use 'hgfe dcba' to denote a full Intel® Xeon Phi” Coprocessor Instruction Set Architecture source register, with 
each letter referring to a 64 bit element, where ‘a’ is the least significant element and ‘'h' is the most significant 
element. So, for example, 'dcba dcba' shows that the source elements are copied to the destination by replicating 
the lower 256 bits of the source (the four least significant elements) to each 256-bit block of the destination. 


Table 2.9 shows the available data conversion primitives for 32 bit Load UpConv and for the different datatypes 
supported. 


Table 2.11 shows the 64 bit counterpart of Load UpConv. As shown, no 64 bit conversions are available but the 
pure "no-conversion" option. 


2.2.3 Down-Conversion 


Vector store instructions can perform a wide variety of data conversions to the data on the way to memory. 
We will refer to this process as down-conversion, and we will use DownConv to describe the store conversion 
function itself. 


DownConv may have destination memory operands with sizes smaller than 64 bytes, as a result of data conver- 
sion. Each destination memory operand must have an address that is aligned to the number of bytes of memory 
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UpConvi64 (INT64) 


S'9$1Spo || Function: Usage 

000 no conversion [rax] {8to8} or [rax] 
001 reserved N/A 

010 reserved N/A 

011 reserved N/A 

100 reserved N/A 

101 reserved N/A 

110 reserved N/A 

111 reserved N/A 
UpConv ea (FP 64) 

S9S1Spo || Function: Usage 

000 no conversion [rax] {8to8} or [rax] 
001 reserved N/A 

010 reserved N/A 

011 reserved N/A 

100 reserved N/A 

101 reserved N/A 

110 reserved N/A 

111 reserved N/A 


Table 2.11: 64 bit Load UpConv conversion primitives. 


DownConv,32 (INT32) 


S255 || Function: Usage 

000 no conversion zmm1 

001 reserved N/A 

010 reserved N/A 

011 reserved N/A 

100 uint32 to uint8 zmm1 {uint8} 
101 sint32 to sint8 zmm1 {sint8} 
110 uint32 to uint16 zmm1 {uint16} 
111 sint32 to sint16 zmm1 {sint16 } 


DownConv 32 (FP32) 


S251Spo || Function: Usage 

000 no conversion zmm1 

001 reserved N/A 

010 reserved N/A 

011 float32 to float16 zmm1 {float16} 
100 float32 to uint8 zmm1 {uint8} 
101 float32 to sint8 zmm1 {sint8} 
110 float32 to uint16 zmm1 {uint16} 
111 float32 to sint16 zmm1 {sint16 } 


Table 2.12: 32 bit DownConv conversion primitives. Unless otherwise noted, all conversions from floating- 


point use MXCSR.RC 
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DownConvie4 (INT64) 


S251Sp || Function: Usage 
000 no conversion zmm1 
001 reserved N/A 
010 reserved N/A 
011 reserved N/A 
100 reserved N/A 
101 reserved N/A 
110 reserved N/A 
111 reserved N/A 


DownConv 64 (FP64) 


S255 || Function: Usage 
000 no conversion zmm1 
001 reserved N/A 
010 reserved N/A 
011 reserved N/A 
100 reserved N/A 
101 reserved N/A 
110 reserved N/A 
111 reserved N/A 


Table 2.13: 64 bit DownConv conversion primitives. 


actually accessed by the operand (that is, after data conversion is performed); otherwise, a #GP fault will result. 
Thus, any of 1-byte, 2-byte, 4-byte, 8-byte, 16-byte, 32-byte, or 64-byte alignment may be required. 


Table 2.12 shows the available data conversion primitives for 32 bit DownConv and for the different supported 
datatypes. 


Table 2.13 shows the 64 bit counterpart of DownConv. As shown, no 64 bit conversions are available but the 
pure "no-conversion" option. 


2.3 Static Rounding Mode 


As described before, the Intel® Xeon Phi” coprocessor introduces a new instruction attribute on top of the nor- 
mal register swizzles called Static (per instruction) Rounding Mode or Rounding Mode override. This attribute 
allows statically applying a specific arithmetic rounding mode ignoring the value of RM bits in MXCSR. 


Static Rounding Mode can be enabled in the encoding of the instruction by setting the EH bit to 1 in a register- 
register vector instruction. Table 2.14 shows the available rounding modes and their encoding. On top of the 
rounding-mode, the Intel® Xeon Phi” coprocessor also allows to set the SAE ("suppress-all-exceptions") at- 
tribute, to disable reporting any floating-point exception flag on MXCSR. This option is available, even if the 
instruction does not perform any kind of rounding. 


Note that some instructions already allow to specify the rounding mode statically via immediate bits. In such 
case, the immediate bits take precedence over the swizzle-specified rounding mode (in the same way that they 
take precedence over the MXCSR.RC setting). 
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525159 || Rounding Mode Override Usage 
000 Round To Nearest (even) , {rn} 
001 Round Down (-INF) , {rd} 
010 Round Up (+INF) , {ru} 
011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 
101 Round Down (-INF) with SAE , {rd-sae} 
110 Round Up (+INF) with SAE , {ru-sae} 
111 Round Toward Zero with SAE , {rz-sae} 
1xx SAE , {sae} 


Table 2.14: Static Rounding-Mode Swizzle available modes plus SAE. 


2.4 Intel’ Xeon Phi coprocessor Execution Environments 


The Intel® Xeon Phi” coprocessor's support for 32 bit and 64 bit execution environments are similar to those 
found in the Intel64® Intel® Architecture Software Developer's Manual. The 64 bit execution environment of the 
Intel® Xeon Phi” coprocessor is shown in Figure 2.1. The layout of 512-bit vector registers and vector mask reg- 
isters are shown in Figure 2.2. This section describes new features associated with the 512-bit vector registers 
and the 16 bit vector mask registers. 


Intel® Xeon Phi” Coprocessor Instruction Set Architecture defines two new sets of registers that hold the new 
vector state. The Intel® Xeon Phi” Coprocessor Instruction Set Architecture extension uses the vector registers, 
the vector mask registers and/or the x86 64 general purpose registers. 


Intel® Xeon Phi" Coprocessor Instruction Set Architecture Vector Registers. The 32 registers each store store 
16 doubleword/single precision floating-point entries (or 8 quadword/double precision floating-point 
entries), and serve as source and destination operands for vector packed floating point and integer opera- 
tions. Additionally, they may also contain memory pointer offsets used to gather and scatter data from/to 
memory. These registers are referenced as zmm0 through zmm31. 


Vector Mask Registers. These registers specify which vector elements are operated on and written for Intel® 
Xeon Phi” Coprocessor Instruction Set Architecture vector instructions. If the Nth bit of a vector mask reg- 
ister is set, then the Nth element of the destination vector is overridden with the result of the operation; 
otherwise, the element remains unchanged. A vector mask register can be set using vector compare in- 
structions, instructions to move contents from a GP register, or a special subset of vector mask arithmetic 
instructions. 


The Intel® Xeon Phi" Coprocessor Instruction Set Architecture vector instructions are able to report ex- 
ceptions via MXCSR flags but never cause traps as all SIMD floating-point exceptions are always masked 
(unlike Intel® SSE/Intel® AVX instructions in other processors, that may trap if floating-point exceptions 
are unmasked, depending on the value of the OM/UM/IM/PM/DM/ZM bits). The reason is that the Intel® 
Xeon Phi” coprocessor forces the new DUE bit (Disable Unmasked Exceptions) in the MXCSR (bit21) to be 
set to 1. 


On the Intel® Xeon Phi” coprocessor, both single precision and double precision floating-point instructions 
use MXCSR.DAZ and MXCSR.FZ to decide whether to treat input denormals as zeros or to flush tiny results 
to zero (the latter are in most cases - but not always - denormal results which are flushed to zero when 
MXCSR.FZ is set to 1; see the IEEE Standard 754-2008, section 7.5, for a definition of tiny floating-point 
results). 


Table 2.15 shows the bit layout of the MXCSR control register. 
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Basic Program Execution Registers Address Space 


Sixteen 64 bit 2464-1 
Registers General-Purpose Registers 
ae * me Segment Registers 
Registers 


RIP (Instruction Pointer Register) 


FPU Registers : 
Eight 80 bit 

Registers Floating-Point Data Registers 
Control Register 
Status Register 
Tag Register 

[ Opcode Register (11 bits) 
FPU Instruction Pointer Register 
FPU Data (Operand) Pointer Register 


Vector Registers 


Thirty-two 512 bit 


Vector Registers 


Registers 


Eight 16 bit | Vector Mask Registers 


Registers 


MXCSR Register 


Figure 2.1: 64 bit Execution Environment 
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Figure 2.2: Vector and Vector Mask Registers 
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MXCSR bit 20 is reserved, however it is not reported as Reserved by MXCSR_MASK. Setting this bit will 


result in undefined behavior 


General-purpose registers. The sixteen general-purpose registers are available in the Intel® Xeon Phi” copro- 
cessor's 64 bit mode execution environment. These registers are identical to those available in the 64 bit 
execution environment described in the Intel64® Intel® Architecture Software Developer's Manual. 


EFLAGS register. R/EFLAGS are updated by instructions according to the Intel64® Intel® Architecture Soft- 
ware Developer's Manual. Additionally, it is also updated by the Intel® Xeon Phi” coprocessor's KORTEST 


instruction. 


FCW and FSW registers. Used by x87 instruction set extensions to set rounding modes, exception masks and 
flags in the case of the FCW, and to keep track of exceptions in the case of the FSW. 


x87 stack. An eight-element stack used to perform floating-point operations on 32/64/80-bit floating-point 
data using the x87 instruction set. 


Bit fields 


31-22 
21 
20-16 
15 
14-13 
12-7 
6 


OrPNWHU 


Field 


Reserved 


DUE 


Reserved 


FZ 


RC 


Reserved 


DAZ 


PE 


UE 


OE 


ZE 


DE 


IE 


Description 


Reserved bits 

Disable Unmasked Exceptions (always set to 1) 
Reserved bits 

Flush To Zero 

Rounding Control 

Reserved bits (IM/DM/ZM/OM/UM/PM in other proliferations) 
Denormals Are Zeros 

Precision Flag 

Underflow Flag 

Overflow Flag 

Divide-by-Zero Flag 

Denormal Operation Flag 

Invalid Operation Flag 


Table 2.15: MXCSR bit layout. Note: MXCSR bit 20 is reserved, however it is not reported as Reserved by 
MXCSR_MASK. Setting this bit will result in undefined behavior 
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Chapter 3 


Intel’ Xeon Phi Coprocessor Instruction 
Set Architecture Format 


This chapter describes the instruction encoding format and assembly instruction syntax of new instructions 
supported by the Intel® Xeon Phi” coprocessor. 


3.1 Overview 


The Intel® Xeon Phi” coprocessor introduces 512-bit vector instructions operating on 512-bit vector registers 
(zmm0-zmm31), and offers vector mask registers (k0-k7) to support a rich set of conditional operations on data 
elements within the zmm registers. Vector instructions operating on zmm registers are encoded using a multi- 
byte prefix encoding scheme, with 62H being the 1st of the multi-byte prefix. This multi-byte prefix is referred 
to as MVEX in this document. 


Instructions operating on the vector mask registers are encoded using another multi-byte prefix, with C4H or 
C5H being the 1st of the multi-byte prefix. This multi-byte prefix is similar to the VEX prefix that is defined in 
the "Intel® Architecture Instruction Set Architecture Programming Reference". We will refer to the C4H/C5H 
based VEX-like prefix as "VEX" in this document. Additionally, the Intel® Xeon Phi” coprocessor also provides a 
handful of new instructions operating on general-purpose registers but are encoded using VEX. In some cases, 
new scalar instructions supported by the Intel® Xeon Phi” coprocessor can be encoded with either MVEX or 
VEX. 
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— - 0,1,2.4 


Figure 3.1: New Instruction Encoding Format with MVEX Prefix 


# Bytes 0,1,2.4 


ict tae) baal tna at a 


Figure 3.2: New Instruction Encoding Format with VEX Prefix 


3.2 Instruction Formats 


Instructions encoded by MVEX have the format shown in Figure 3.1. 


Instructions encoded by VEX have the format shown in Figure 3.2. 


3.2.1 MVEX/VEX and the LOCK prefix 


Any MVEX-encoded or VEX-encoded instruction with a LOCK prefix preceding the multi-byte prefix will generate 
an invalid opcode exception (#UD). 


3.2.2 MVEX/VEX and the 66H, F2H, and F3H prefixes 


Any MVEX-encoded or VEX-encoded instruction with a 66H, F2H, or F3H prefix preceding the multi-byte prefix 
will generate an invalid opcode exception (#UD). 


3.2.3 MVEX/VEX and the REX prefix 


Any MVEX-encoded or VEX-encoded instruction with a REX prefix preceding the multi-byte prefix will generate 
an invalid opcode exception (#UD). 


Reference Number: 327364-001 41 


intel 
CHAPTER 3. INTEL’ XEON PHI’ COPROCESSOR INSTRUCTION SET ARCHITECTURE FORMAT (inte’ 


3.3. The MVEX Prefix 


The MVEX prefix consists of four bytes that must lead with byte 62H. An MVEX-encoded instruction supports 
up to three operands in its syntax and is operating on vectors in vector registers or memory using a vector mask 
register to control the conditional processing of individual data elements in a vector. Swizzling, conversion and 
other operations on data elements within a vector can be encoded with bit fields in the MVEX prefix, as shown 
in Figure 3.3. The functionality of these bit fields is summarized below: 


¢ 64 bit mode register specifier encoding (R, X, B, R', W, V') for memory and vector register operands (en- 
coded in 1's complement form). 


- Avector register as source or destination operand is encoded by combining the R'R bits with the reg 
field, or the XB bits with the r/m field of the modR/M byte. 


- The base of a memory operand is a general purpose register encoded by combining the B bit with the 
r/m field. The index of a memory operand is a general purpose register encoded by combining the X 
bit with the SIB.index field. 


- The vector index operand in the gather/scatter instruction family is a vector register, encoded by 
combining the VX bits with the SIB.index field. MVEX.vvvv is not used in the gather/scatter instruc- 
tion family. 


¢ Non-destructive source register specifier (applicable to the three operand syntax): This is the first source 
operand in the three-operand instruction syntax. It is represented by the notation, MVEX.vvvv. It can 
encode any of the lower 16 zmm vector registers, or using the low 3 bits to encode a vector mask register 
as a source operand. It can be combined with V to encode any of the 32 zmm vector registers 


¢ Vector mask register and masking control: The MVEX.aaa field encodes a vector mask register that is 
used in controlling the conditional processing operation on the data elements of a 512-bit vector instruc- 
tion. The MVEX.aaa field does not encode a source or a destination operand. When the encoded value of 
MVExX.aaa is 000b, this corresponds to "no vector mask register will act as conditional mask for the vector 
instruction". 


¢ Non-temporal/eviction hint. The MVEX.E field can encode a hint to the processor on a memory referencing 
instruction that the data is non-temporal and can be prioritized for eviction. When an instruction encoding 
does not reference any memory operand, this bit may also be used to control the function of the MVEX.SSS 
field. 

¢ Compaction of legacy prefixes (66H, F2H, F3H): This is encoded in the MVEX.pp field. 


¢ Compaction of two-byte and three-byte opcode: This is encoded in the MVEX.mmmm field. 


¢ Register swizzle/memory conversion operations (broadcast/up-convert/down-convert) /static-rounding 
override: This is encoded in the MVEX.SSS field. 


- Swizzle operation is supported only for register-register syntax of 512-bit vector instruction, and re- 
quires MVEX.E = 0, the encoding of MVEX.SSS determines the exact swizzle operation - see Section 2.2 


- Static rounding override only applies to register-register syntax of vector floating-point instructions, 
and requires MVEX.E = 1. 


The MVEX prefix is required to be the last prefix and immediately precedes the opcode bytes. 
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Byte 0 Byte 1 Byte 2 Byte 3 
cme Is] om [of pegs 


RXBR’: 64-bit mode register specifier associated with reg and r'm encoding in 1’s 
complement form. 
mmmm: 
0000: may be used to encode scalar mask instructions 
0001: implied OF leading opcode byte 
0010: imphed OF 38 leading opcode bytes 
0011: implied OF 3A leading opcode bytes 
0100-1111: Reserved for future use (will #UD) 
W: Opcode extension or 64-bit osize (operand size) promotion. 
V’vvvwv: A non-destructive register specifier (m 1’s complement form) or 11111 if unused. 


pp: Compaction of 66/F2/F3 prefix 
00: None 
01: 66 
10: F3 
11: F2 
E: Non-temporal/eviction hint. 
SSS: Swizzle/broadcast/up-convert/down-convert/static-roundng controls. 
aaa: Vector mask register for masking control. 


Figure 3.3: MVEX bitfields 
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3.3.1 Vector SIB (VSIB) Memory Addressing 


In the gather/scatter instruction family, an SIB byte that follows the ModR/M byte can support VSIB memory 
addressing to an array of linear addresses. VSIB memory addressing is supported only with the MVEX prefix. 


In VSIB memory addressing, the SIB byte consists of: 


¢ The scale field (bit 7:6), which specifies the scale factor. 


¢ The index field (bits 5:3), which is prepended with the 2-bit logical value of the MVEX.V'X bits to specify 
the vector register number of the vector index operand; each element in the vector register specifies an 
index. 


¢ The base field (bits 2:0) is prepended with the logical value of MVEX.B field to specify the register number 
of the base register. 


3.4 The VEX Prefix 


The VEX prefix is encoded in either the two-byte form (the first byte must be C5H) or in the three-byte form (the 
first byte must be C4H). Beyond the first byte, the VEX prefix consists of a number of bit fields providing specific 
capability; they are shown in Figure 3.4. 

The functionality of the bit fields is summarized below: 


64 bit mode register specifier encoding (R, X, B, W): The R/X/B bit field is combined with the lower three 
bits or register operand encoding in the modR/M byte to access the upper half of the 16 registers available 
in 64 bit mode. The VEX.R, VEX.X, VEX.B fields replace the functionality of REX.R, REX.X, REX.B bit fields. 
The W bit either replaces the functionality of REX.W or serves as an opcode extension bit. The usage of the 
VEX.WRXB bits is explained in detail in section 2.2.1.2 of the Intel® 64 and IA-32 Architectures Software 
developer's manual, Volume 2A. This bit is stored in 1's complement form (bit inverted format). 


Non-destructive source register specifier (applicable to three operand syntax): this is the first source 
operand in the instruction syntax. It is represented by the notation, VEX.vvvv. It can encode any general- 
purpose register, or using only 3 bits it can encode vector mask registers. This field is encoded using 1's 
complement form (bit inverted form), i.e. RAX/KO is encoded as 1111B, and R15 is encoded as OOOOB. 


Compaction of legacy prefixes (66H, F2H, F3H): This is encoded in the VEX.pp field. 


¢ Compaction of two-byte and three-byte opcode: This is encoded in the VEX.mmmmm field. 


The VEX prefix is required to be the last prefix and immediately precedes the opcode bytes. It must follow any 
other prefixes. If the VEX prefix is present a REX prefix is not supported. 
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Byte 0 Byte 1 Byte 2 

(Bit Position) 7 07654 ae ae 
7 32190 

2-byte VEX 11000101 vw 


RXB: 64-bit mode register specifier associated with reg and r/m operand encoding. 
m-mmmm: 
00001: implied OF leading opcode byte 
00010: implied OF 38 leading opcode bytes 
00011: implied OF 3A leading opcode bytes 
00100-11111: Reserved for future use (will UD) 
W: Opcode extension or 64-bit osize (operand size) promotion. 
vvvv: A non-destructive register specifier (in 1°s complement form) or 1111 if unused. 
pp: Compaction of 66/F2/F3 prefix 
00: None 
01: 66 
10: F3 
11: F2 


Figure 3.4: VEX bitfields 
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3.5 Intel’ Xeon Phi Coprocessor Instruction Set Architecture Assembly 
Syntax 


Intel® Xeon Phi” Coprocessor Instruction Set Architecture supports up to three operands. The rich encoding fields 
for swizzle/broadcast/convert/rounding, masking control, and non-temporal hint are expressed as modifier 
expressions to the respective operands in the assembly syntax. A few common forms for the Intel® Xeon Phi™ 
coprocessor assembly instruction syntax are expressed in the general form: 


mnemonic vreg{masking modifier}, sourcel, transform_modifier (vreg/mem) 
mnemonic vreg{masking modifier}, sourcel, transform_modifier(vreg/mem), imm 
mnemonic mem{masking modifier}, transform_modifier (vreg) 


The specific forms to express assembly syntax operands, modifiers, and transformations are listed in Table 3.1. 


3.6 Notation 


The notation used to describe the operation of each instruction is given as a sequence of control and assignment 
statements in C-like syntax. This document only contains the notation specifically needed for vector instructions. 
Standard Intel® 64 notation may be found at IA-32 Intel® Architecture Software Developer's Manual: Volume 2 
for convenience. 


When instructions are represented symbolically, the following notations are used: 
label: mnemonic argument1 {write-mask}, argument2, argument3, argument4. ... 


where: 


¢ Amnemonic is a reserved name for a class of instruction opcodes which have the same function. 


¢ The operands argument1, argumentz2, argument3, argument4, and so on are optional. There may be from 
one to three register operands, depending on the opcode. The leftmost operand is always the destina- 
tion; for certain instructions, such as vfmadd231ps, it may be a source as well. When the second leftmost 
operand is a vector mask register, it may in certain cases be a destination as well, as for example with the 
vpsubrsetbd instruction. All other register operands are sources. There may also be additional arguments 
in the form of immediate operands; for example, the vcvtfxpntdq2ps instructions has a 3-bit immediate 
field that specifies the exponent adjustment to be performed, if any. The write-mask operand specifies the 
vector mask mask register used to control the selective updating of elements in the destination register or 
registers. 


3.6.1 Operand Notation 


In this manual we will consider vector registers from several perspectives. One perspective is is as an array of 
64 bytes. Another is as an array of 16 doubleword elements. Another is an array of 8 quadword elements. Yet 
another is as an array of 512 bits. In the mnemonic operation description pseudo-code, registers will be ad- 
dressed using bit ranges, such as: 
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i = n*32 
zmmi1 [it+31:i] 


This example refers to the 32 bits of the n-th doubleword element of vector register zmm1. 


We will use a similar bit-oriented notation to describe access to vector mask registers. In the case of vector mask 
registers, we will usually specify a single bit, rather than a range of bits, because vector mask registers are used 
for predication, carry, borrow, and comparison results, and a single bit per element is enough for any of those 
purposes. 


Using this notation, it is for example possible to test the value of the 12°” bit in k1 as follows: 


if ( ki[11] == 1) { ... code here ... } 


Tables 3.1 and 3.2 summarize the notation used for instruction operands and their values. 


In Intel® Xeon Phi" Coprocessor Instruction Set Architecture, the contents of vector registers are variously inter- 
preted as floating-point values (either 32 or 64 bits), integer values, or simply doubleword values of no particular 
data type, depending on the instruction semantics. 


3.6.2 The Displacement Bytes 


The Intel® Xeon Phi” coprocessor introduces a brand new displacement representation that allows for a more 
compact encoding in unrolled code: compressed displacement of 8-bits, or disp8*N. Such compressed displace- 
ment is based on the assumption that the effective displacement is a multiple of the granularity of the memory 
access, and hence we do not need to encode the redundant low-order bits of the address offset. 


Intel® Xeon Phi" Coprocessor Instruction Set Architecture using the MVEX prefix (i.e. using encoding 62) have the 
following displacement options: 


¢ No displacement 


¢ 32 bit displacement: this displacement works exactly the same as the legacy 32 bit displacement and 
works at byte granularity 


¢ Compressed 8 bit displacement (disp8*N): this displacement format substitutes the legacy 8-bit displace- 
mentin Intel® Xeon Phi” Coprocessor Instruction Set Architecture using map 62. This displacement assumes 
the same granularity as the memory operand size (which is dependent on the instructions and the memory 
conversion function being used). Redundant low-order bits are ignored and hence, 8-bit displacements 
are reinterpreted so that they are multiplied by the memory operands total size in order to generate the 
final displacement to be used in calculating the effective address. 


Note that the displacements in the MVEX vector instruction prefix are encoded in exactly the same way as regular 
displacements (so there are no changes in the ModRM/SIB encoding rules), with the only exception that disp8 is 
overloaded to disp8*N. In other words there are no changes in the encoding rules or encoding lengths, but only 
in the interpretation of the displacement value by hardware (which needs to scale the displacement by the size 
of the memory operand to obtain a byte-wise address offset). 


Reference Number: 327364-001 47 


CHAPTER 3. INTEL’ XEON PHI’ COPROCESSOR INSTRUCTION SET ARCHITECTURE FORMAT 


Notation Meaning 

zmm1 A vector register operand in the argument! field of the instruction. The 64 byte 
vector registers are: zmm0 through zmm31 

zmm2 A vector register operand in the argumentz field of the instruction. The 64 byte 
vector registers are: zmm0 through zmm31 

zmm3 A vector register operand in the arguments3 field of the instruction. The 64 byte 
vector registers are: zmm0 through zmm31 

S'p32(zmm/m) A vector floating-point 32 bit swizzle/conversion. Refer to Table 2.2 for register 
sources and Table 2.4 for memory conversions. 

S'r64(zmm/m) A vector floating-point 64 bit swizzle/conversion. Refer to Table 2.3 for register 
sources and Table 2.6 for memory conversions. 

Si32(zmm/m) A vector integer 32 bit swizzle/conversion. Refer to Table 2.2 for register sources 
and Table 2.5 for memory conversions. 

Sie4(zmm/m) A vector integer 64 bit swizzle/conversion. Refer to Table 2.3 for register sources 
and Table 2.7 for memory conversions. 

Uy32(m) A floating-point 32 bit load Up-conversion. Refer to Table 2.9 for the memory 
conversions available for all the different datatypes. 

U;32(m) An integer 32 bit load Up-conversion. Refer to Table 2.9 for the memory conver- 
sions available for all the different datatypes. 

Uyea(m) A floating-point 64 bit load Up-conversion. Refer to Table 2.11 for the memory 
conversions available for all the different datatypes. 

Ui64(m) An integer 64 bit load Up-conversion. Refer to Table 2.11 for the memory conver- 
sions available for all the different datatypes. 

D 32(zmm) A floating-point 32 bit store Down-conversion. Refer to Table 2.12 for the memory 
conversions available for all the different datatypes. 

Di32(zmm) An integer 32 bit store Down-conversion. Refer to Table 2.12 for the memory 
conversions available for all the different datatypes. 

D 64(zmm) A floating-point 64 bit store Down-conversion. Refer to Table 2.13 for the memory 
conversions available for all the different datatypes. 

Djga(zmm) An integer 64 bit store Down-conversion. Refer to Table 2.13 for the memory 
conversions available for all the different datatypes. 

m A memory operand. 

me A memory operand that may have an EH hint attribute. 

MuvU¢t A vector memory operand that may have an EH hint attribute. This memory 


effective_address 


operand is encoded using ModRM and VSIB bytes. It can be seen as a set of point- 
ers where each pointer is equal to BASE + VINDEX(i] x SCALE 
Used to denote the full effective address when dealing with a memory operand. 


imm8 An immediate byte value. 

SRC[a-b] A bit-field from an operand ranging from LSB b to MSB a. 
Table 3.1: Operand Notation 

Notation Meaning 


zmm1[i+31:i] 
zmm2[i+31:i] 


k1 [i] 


The value of the element located between bit 7 and bit 7 + 31 of the argument1 
vector operand. 
The value of the element located between bit 7 and bit 2 + 31 of the argument2 
vector operand. 

Specifies the i-th bit in the vector mask register k1. 
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Table 3.2: Vector Operand Value Notation 
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3.6.3. Memory size and disp8*N calculation 


Table 3.3 and Table 3.4 show the size of the vector (or element) being accessed in memory, which is equal to the 
scaling factor for compressed displacement (disp8*N). Note that some instructions work at element granularity 
instead of full vector granularity at memory level, and hence should use the "element level" column in Table 3.3 
and Table 3.4 (namely VlIOADUNPACK, VPACKSTORE, VGATHER, and VSCATTER instructions). 


Table 3.3: Size of vector or element accessed in memory for up- 
conversion 


Reference Number: 327364-001 


Function || Usage Memory accessed / Disp8*N 
U/S p32 Nobroadcast 4to16 broadcast 1to16 broadcast 
or element level 
000 [rax] {16to16} or [rax] 64 16 4 
001 [rax] {1to16} 4 NA NA 
010 [rax] {4to16} 16 NA NA 
011 [rax] {float16} 32 8 2 
100 [rax] {uint8} 16 4 1 
101 [rax] {sint8} 16 4 1 
110 [rax] {uint16} 32 8 2 
111 [rax] {sint16} 32 8 2 
U/S;32 No broadcast 4to16 broadcast 1to16 broadcast 
or element level 
000 [rax] {16to16} or [rax] 64 16 4 
001 [rax] {1to16} 4 NA NA 
010 [rax] {4to16} 16 NA NA 
011 N/A NA NA NA 
100 [rax] {uint8} 16 4 1 
101 [rax] {sint8} 16 4 1 
110 [rax] {uint16} 32 8 2 
111 [rax] {sint16} 32 8 2 
U/S sea Nobroadcast 4to8broadcast  1to8 broadcast 
or element level 
000 [rax] {8to8} or [rax] 64 32 8 
001 [rax] {1to8} 8 NA NA 
010 [rax] {4to8} 32 NA NA 
011 N/A NA NA NA 
100 N/A NA NA NA 
101 N/A NA NA NA 
110 N/A NA NA NA 
111 N/A NA NA NA 
U/Siea No broadcast 4to8 broadcast 1to8 broadcast 
or element level 
000 [rax] {8to8} or [rax] 64 32 8 
001 [rax] {1to8} 8 NA NA 
010 [rax] {4to8} 32 NA NA 
011 N/A NA NA NA 
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Table 3.3: Size of vector or element accessed in memory for up- 
conversion 


Function || Usage Memory accessed / Disp8*N 

100 N/A NA NA NA 
101 N/A NA NA NA 
110 N/A NA NA NA 
111 N/A NA NA NA 


Table 3.4: Size of vector or element accessed in memory for down- 
conversion 


Function || Usage Memory accessed / Disp8*N 

Dys32 Regular store Element level 
000 zmm1 64 4 
001 N/A NA NA 
010 N/A NA NA 
011 zmm1 {float16} 32 2 
100 zmm1 {uint8} 16 1 
101 zmm1 {sint8} 16 1 
110 zmm1 {uint16} 32 2 
111 zmm1 {sint16} 32 2 
Drea Regular store Element level 
000 zmm1 64 8 
001 N/A NA NA 
010 N/A NA NA 
011 N/A NA NA 
100 N/A NA NA 
101 N/A NA NA 
110 N/A NA NA 
111 N/A NA NA 
Die Regular store Element level 
000 zmm1 64 8 
001 N/A NA NA 
010 N/A NA NA 
011 N/A NA NA 
100 N/A NA NA 
101 N/A NA NA 
110 N/A NA NA 
111 N/A NA NA 
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3.7 EH hint 


All vector instructions that access memory provide the option of specifying a cache-line eviction hint, EH. 


EH is a performance hint, and may operate in different ways or even be completely ignored in different hardware 
implementations. The Intel® Xeon Phi” coprocessor is designed to provide support for cache-efficient access 
to memory locations that have either low temporal locality of access or bursts of a few very closely bunched 
accesses. 


There are two distinct modes of EH hint operation, one for prefetching and one for loads, stores, and load-op 
instructions. 


The interaction of the EH hint with prefetching is summarized in Table 3.5. 


EH value Hit behavior Miss behavior 
EH not set | Make data MRU | Fetch data and make it MRU 
EH set Make data MRU | Fetch data into way #N, where N is the 
thread number, and make it MRU 


Table 3.5: Prefetch behavior based on the EH (cache-line eviction hint) 


The above table describes the effect of the EH bit on gather/scatter prefetches into the targeted cache (e.g. L1 
for vgatherpf0dps, L2 for vgatherpfldps). If vgatherpfOdps misses both L1 and L2, the resulting prefetch into L1 
is anon-temporal prefetch into way #N of L1, but the prefetch into L2 is a normal prefetch, not a non-temporal 
prefetch. If you want the data to be non-temporally fetched into L2, you must use vgatherpfldps with the EH bit 
set. 


The operation of the EH hint with prefetching is designed to limit the cache impact of streaming data. 


Note that regular prefetch instructions (like vprefetchO) do not have an embedded EH hint. Instead, the non- 
temporal hint is given by the opcode/mnemonic (see VPREFETCHNTA/0/1/2 descriptions for details). The 
same rules described in Table 3.5 still apply. 


Table 3.6 summarizes the interaction of the EH hint with load and load-op instructions. 


EH value L1 hit behavior | L1 miss behavior 
EH not set | Make data MRU | Fetch data and make it MRU 
EH set Make data LRU | Fetch data and make it MRU 


Table 3.6: Load/load-op behavior based on the EH bit. 


The EH bit, when used with load and load-op instructions, affects only the L1 cache behavior. Any resulting L2 
misses are handled normally, regardless of the setting of the EH bit. 


Table 3.7 summarizes the interaction of the EH hint with store instructions. Note that stores that write a full 
cache-line (no mask, no down-conversion) evict the line from L1 (invalidation) while updating the contents 
directly into the L2 cache. In any other case, a store with an EH hint works as a load with an EH hint. 


The EH bit, when used with load and load-op instructions, affects only the L1 cache behavior. Any resulting L2 
misses are handled normally, regardless of the setting of the EH bit. 
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EH value Store type L1 hit behavior L1 miss behavior 

EH not set Make data MRU Fetch data and make it MRU 
EH set No mask, no downconv. | Invalidate L1 - Update L2 | Fetch data and make it MRU 
EH set Mask or downconv. Make data LRU Fetch data and make it MRU 


Table 3.7: Store behavior based on the EH bit. 
3.8 Functions and Tables Used 


Some mnemonic definitions use auxiliary tables and functions to ease the process of describing the operations of 
the instruction. The following section describes those tables and functions that do not have an obvious meaning. 


3.8.1 MemtLoad and MemStore 


This document uses two functions, Mem-Load and MemStore, to describe in pseudo-code memory transfers that 
involve no conversions or broadcasts: 


¢ MemLoad: Given an address pointer, this function returns the associated data from memory. Size is de- 
fined by the explicit destination size in the pseudo-code (see for example LDMXCSR in Appendix B) 


¢ MemStore: Given an address pointer, this function stores the associated data to memory. Size is defined 
by the explicit source data size in the pseudo-code. 


3.8.2 SwizzUpConvLload, UpConvLoad and DownConvStore 


In this document, the detailed discussions of memory-accessing instructions that support datatype conversion 
and/or broadcast (as defined by the UpConv, SwizzUpConv, and DownConv tables in section 2.2) use the func- 
tions shown in Table 3.8 in their Operation sections (the instruction pseudo-code). These functions are used 
to describe any swizzle, broadcast, and/or conversion that can be performed by the instruction, as well as the 
actual load in the case of SwizzUpConv and UpConv. Note that zmm/m means that the source may be either a 
vector operand or a memory operand, depending on the ModR/M encoding. 


The Operation section may use UpConvSizeOf, which returns the final size (in bytes) of an up-converted memory 
element given a specified up-conversion mode. A specific subset of amemory stream may be used as a parameter 
for UpConv; Size of the subset is inferred by the size of destination together with the up-conversion mode. 


Additionally, the Operation section may also use DownConvStoreSizeOf, which returns the final size (in bytes) of 
a downcoverted vector element given a specified down-conversion mode. A specific subset of a vector register 


may be used as a parameter for DownConvsStore; for example, DownConvStore(zmm2[31:0]) specifies that the 
low 32 bits of zmm2 form the parameter for DownConv. 


3.8.3 Other Functions/Identifiers 


The following identifiers are used in the algorithmic descriptions: 
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Swizzle/conversion used 


Function used in operation description 


Sp32(zmm/m) SwizzUpConvLoad y32(zmm/m) 
Srea(zmm/m) SwizzUpConvLoad ¢g4(zmm/m) 
Sizo(zmm/m) SwizzUpConvLoad;32(zmm/m) 
Sigs(zmm/m) SwizzUpConvLoad;g4(zmm/m) 
Us32(m) UpConvLoad ¢32(m) 
Ui32(m) UpConvLoad;32(m) 
Usea(m) UpConvLoad fg4(m) 
Uiga(m) UpConvLoad;g4(m) 
Dy32(zmm) DownConvStore ¢32(zmm) or DownConvStore ¢32(zmm[xx:yy]) 
Di32(zmm) DownConvStore;32(zmm) or DownConvStore;32(zmm[xx:yy]) 
Dyea(zmm) DownConvStore rg4(zmm) or DownConvStore f¢4(zmm|[xx:yy]) 
Djga(zmm) DownConvStore;g4(zmm) or DownConvStore;g4(zmm[xx:yy]) 


Table 3.8: SwizzUpConv, UpConv and DownConv function conventions 
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Carry - The carry bit from an addition. 


Abs - The absolute value of a number. 

IMax - The greater of two signed integer numbers. 

UMax - The greater of two unsigned integer numbers. 

IMin - The lesser of two signed integer numbers. 

UMin - The lesser of two unsigned integer numbers. 

CvtInt32ToFloat32 - Convert a signed 32 bit integer number to a 32 bit floating-point number. 


CvtInt32ToFloat64 - Convert a signed 32 bit integer number to a 64 bit floating-point number. 


CvtFloat32ToFloat64 - Convert a 32 bit floating-point number to a 64 bit floating-point number. 


FpMaxAbs - The greater of the absolute values of two floating-point numbers. See the description of the 
VGMAXABSPS instruction for further details. 


FpMax - The greater of two floating-point numbers. See the description of the V@MAXPS instruction for 
further details. 


FpMin - The lesser of two floating-point numbers. See the description of the VGMINPS instruction for 
further details. 


CvtFloat32ToInt32 - Convert a 32 bit floating-point number to a 32 bit signed integer number using the 
specified rounding mode. 


CvtFloat64ToInt32 - Convert a 64 bit floating-point number to a 32 bit signed integer number using the 
specified rounding mode. 


CvtFloat32ToUint32 - Convert a 32 bit floating-point number to a 32 bit unsigned integer number using 
the specified rounding mode. 


CvtFloat64ToUint32 - Convert a 64 bit floating-point number to a 32 bit unsigned integer number using 
the specified rounding mode. 
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¢ CvtFloat64ToFloat32 - Convert a 64 bit floating-point number to a 32 bit floating-point number using 
the specified rounding mode. 


CvtUint3 2ToFloat32 - Convert an unsigned 32 bit integer number to a 32 bit floating-point number. 


CvtUint3 2ToFloat64 - Convert an unsigned 32 bit integer number to a 64 bit floating-point number. 


¢ GetExp - Obtains the (un-biased) exponent of a given floating-point number, returned in the form of a 32 
bit floating-point number. See the description of the VGETEXPPS instruction for further details. 


¢ RoundTolInt - Rounds a floating-point number to the nearest integer, using the specified rounding mode. 
The result is a floating-point representation of the rounded integer value. 


¢ Borrow - The borrow bit from a subtraction. 
e ZeroExtend - Returns a value zero-extended to the operand-size attribute of the instruction. 


¢ FlushL1CacheLine - Flushes the cache line containing the specified memory address from L1. 


InvalidateCacheLine - Invalidate the cache line containing the specified memory address from the whole 
memory cache hierarchy. 


e FetchL1CacheLine - Prefetches the cache line containing the specified memory address into L1. See the 
description of the VPREFETCH1 instruction for further details. 


e FetchL2CacheLine - Prefetches the cache line containing the specified memory address into L2. See the 
description of the VPREFETCH2 instruction for further details. 
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Chapter 4 


Floating-Point Environment, Memory Ad- 
dressing, and Processor State 


This chapter describes the Intel® Xeon Phi” coprocessor vector floating-point instruction exception behavior 
and interactions related to system programming. 


4.1 Overview 


The Intel® Xeon Phi” coprocessor 512-bit vector instructions that operate on floating-point data may signal 
exceptions related to arithmetic processing. When SIMD floating-point exceptions occur, the Intel® Xeon Phi™ 
coprocessor supports exception reporting using exception flags in the MXCSR register, but traps (unmasked ex- 
ceptions) are not supported. 


Exceptions caused by memory accesses apply to vector floating-point, vector integer, and scalar instructions. 


The MXCSR register (see Figure 4.1) in the Intel® Xeon Phi” coprocessor provides: 


¢ Exception flags to indicate SIMD floating-point exceptions signaled by floating-point instructions operat- 
ing on zmm registers. The flags are: IE, DE, ZE, OE, UE, PE. 
¢ Rounding behavior and control: DAZ, FZ and RC. 


e Exception Suppression: DUE (always 1) 


4.1.1 Suppress All Exceptions Attribute (SAE) 


Intel® Xeon Phi” Coprocessor Instruction Set Architecture that process floating-point data support a specific fea- 
ture to disable floating-point exception signaling, called SAE ("suppress all exceptions"). The SAE mode is en- 
abled via a specific bit in the register swizzle field of the MVEX prefix (by setting the EH bit to 1). When SAE is 
enabled in the instruction encoding, that instruction does not report any SIMD floating-point exception in the 
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161514131211109 8765432 1 0 | 


31 21 
F 

: Reserved Reserved |> Reserved 
: Disable Unmasked Exceptions 
: Flush to Zero 


: Rounding Control 

i Denormals Are Zeros 
: Precision Flag 

: Underflow Flag 

: Overflow Flag 

: Divide-by-Zero Flag 

: Denormal Flag 

i Invalid Operation Flag 


Figure 4.1: MXCSR Control/Status Register 


MXCSR register. This feature is only available to the register-register format of the instructions and in combina- 
tion with static rounding-mode. 


4.1.2 SIMD Floating-Point Exceptions 


SIMD floating-point exceptions are those exceptions that can be generated by Intel® Xeon Phi” Coprocessor In- 
struction Set Architecture that operate on floating-point data in zmm operands. Six classes of SIMD floating-point 
exception flags can be signaled: 


¢ Invalid operation (#]) 

¢ Divide-by-zero (#Z) 

¢ Numeric overflow (#0) 

e¢ Numeric underflow (#U) 

e Inexact result (Precision) (#P) 


¢ Denormal operand (#D) 


4.1.3 SIMD Floating-Point Exception Conditions 


The following sections describe the conditions that cause SIMD floating-point exceptions to be signaled, and the 
masked response of the processor when these conditions are detected. 


When more than one exception is encountered, then the following precedence rules are applied?. 


1Note that the Intel® Xeon Phi” coprocessor has no support for unmasked exceptions, so in this case the exception precedence rules 
have no effect. All concurrently-encountered exceptions will be reported simultaneously. 
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1. Invalid-operation exception caused by sNaN operand 
2. Any other invalid exception condition different from sNaN input operand 
3. Denormal operand exception 
4. A divide-by-zero exception 
5. Overflow/underflow exception 
6 


. Inexact result 


All Intel® Xeon Phi” Coprocessor Instruction Set Architecture floating-point exceptions are precise and are re- 
ported as soon as the instruction completes execution. The status flags from the MXCSR register set by each 
instruction will be the logical OR of the flags set by each of the up to 16 (or 8) individual operations. The status 
flags are sticky and can be cleared only via a LDMXCSR instruction. 


4.1.3.1 Invalid Operation Exception (#1) 


The floating-point invalid-operation exception (#1) occurs in response to an invalid arithmetic operand. The flag 
(IE) and mask (IM) bits for the invalid operation exception are bits 0 and 7, respectively, in the MXCSR register. 


Intel® Xeon Phi” Coprocessor Instruction Set Architecture forces all floating-point exceptions, including invalid- 
operation exceptions, to be masked. Thus, for the #I exception the value returned in the destination register 
is a QNaN, QNaN Indefinite, Integer Indefinite, or one of the source operands. When a value is returned to the 
destination operand, it overwrites the destination register specified by the instruction. Table 4.1 lists the invalid- 
arithmetic operations that the processor detects for instructions and the masked responses to these operations. 


Normally, when one or more of the source operands are QNaNs (and neither is an SNaN or in an unsupported 
format), an invalid-operation exception is not generated. For VCMPPS and VCMPPD when the predicate is one 
of It, le, nlt, or nle, a QNaN source operand does generate an invalid-operation exception. 


Note that divide-by-zero exceptions (like all other floating-point exceptions) are always masked in the Intel® 
Xeon Phi” coprocessor. 


4.1.3.2 Divide-By-Zero Exception (#Z) 


The processor reports a divide-by-zero exception when a VRCP23PS instruction has a 0 operand. 


Note that divide-by-zero exceptions (like all other floating-point exceptions) are always masked in the Intel® 
Xeon Phi” coprocessor. 


4.1.3.3. Denormal Operand Exception (#D) 


The processor reports a denormal operand exception when an arithmetic instruction attempts to operate on a 
denormal operand and the DAZ bit in the MXCSR (the "Denormals Are Zero" bit) is not set to 0 (so that denormal 
operands are not treated as zeros). 


Note that denormal exceptions (like all other floating-point exceptions) are always masked in the Intel® Xeon 
Phi” coprocessor. 
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Condition 


(intel, 
Masked Response 


VADDNPD, VADDNPS, VADDPD, VADDPS, VADDSETSPS, VMULPD, 
VMULPS, VRCP23PS, VRSQRT32PS, VLOG2PS, VSCALEPS, VSUBPD, 
VSUBPS, VSUBRPD or an VSUBRPS instruction with an SNaN 
operand 


Return the SNaN converted to a QNaN. 
For more detailed information refer to 
Table 4.3 


VCMPPD or VCMPPS with QNaN or SNaN operand 


Return 0 (except for the predicates not- 
equal, unordered, not-less-than, or not- 
less- than-or-equal, which return a 1) 


VCVTPD2PS, or VCVTPS2PD instruction with an SNaN operand 


Return the SNaN converted to a QNaN. 


VCVTFXPNTPD2DQ, VCVTFXPNTPD2UDQ, VCVTFXPNTPS2DQ, or 
VCVTFXPNTPS2DQ instruction with an NaN operand 


Return a 0. 


VGATHERD, VMOVAPS, VLOADUNPACKHPS, VLOADUNPACKLPS, or 
VBROADCATSS instruction with SNaN operand and selected Up- 
Conv32 that converts from floating-point to another floating-point 
data type 


Return the SNaN converted to a QNaN. 


VPACKSTOREHPS, VPACKSTORELPS, VSCATTERDPS, or VMOVAPS 
instruction with SNaN operand and selected a DownConv32 that 
converts from float to another float datatype 


Return the SNaN converted to a QNaN. 


VFMADD132PD, VFMADD132PS, VFMADD213PD, VFMADD213PS, 
VFMADD231PD, VFMADD233PS, VFNMSUB132PD, VFNM- 
SUB132PS, VFNMSUB213PD, VFNMSUB213PS, VFNMSUB231PD, 
VNMSUB231PS, VFMSUB132PD, VFMSUB132PS, VFMSUB213PD, 
VFMSUB213PS, VFMSUB231PD, VFMSUB231PS, VFNMADD132PD, 
VFNMADD132PS, VFNMADD213PD, VFNMADD213PS, VEFN- 
MADD231PD, or VFNMADD231PS instruction with an SNaN 
operand. 


Follow rules described in Table 4.4. 


VGMAXPD, VGMAXPS, VGMINPD or VGMINPS instruction with SNaN 
operand 


Returns non NaN operand. If both 
operands are NaN, return first source 
NaN. 


VGMAXABSPS instruction with SNaN operand. 


Returns non NaN operand. If both 
operands are NaN, return first source 
NaN with its sign bit cleared. 


Multiplication of infinity by zero 


Return the QNaN floating-point Indefi- 
nite. 


VGETEXPPS, VRCP23PS, VRSQRT23PS or VRNDFXPNTPS instruc- 
tion with SNaN operand 


Return the SNaN converted to a QNaN. 


VRSQRT23PS instruction with NaN or negative value 


Return the QNaN floating-point Indefi- 
nite. 


Addition of opposite signed infinities or subtraction of like-signed 
infinities 


Return the QNaN floating-point Indefi- 
nite 


Table 4.1: Masked Responses of Intel® Xeon Phi” Coprocessor Instruction Set Architecture to Invalid Arithmetic 


Operations 


4.1.3.4 Numeric Overflow Exception (#0) 


The processor reports a numeric overflow exception whenever the rounded result of an arithmetic instruction 
exceeds the largest allowable finite value that fits in the destination operand. 


Note that overflow exceptions (like all other floating-point exceptions) are always masked in the Intel® Xeon 
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Phi” coprocessor. 


4.1.3.5 Numeric Underflow Exception (#U) 


The processor signals an underflow exception whenever (a) the rounded result of an arithmetic instruction, 
calculated assuming unbounded exponent, is less than the smallest possible normalized finite value that will fit 
in the destination operand (the result is tiny), and (b) the final rounded result, calculated with bounded exponent 
determined by the destination format, is inexact. 


Note that underflow exceptions (like all other floating-point exceptions) are always masked in the Intel® Xeon 
Phi” coprocessor. 


The flush-to-zero control bit provides an additional option for handling numeric underflow exceptions in the 
Intel® Xeon Phi” coprocessor. If set (FZ = 1), tiny results (these are usually, but not always, denormal values) are 
replaced by zeros of the same sign. If not set (FZ=0) then tiny results will be rounded to 0, a denormalized value, 
or the smallest normalized floating-point number in the destination format, with the sign of the exact result. 


4.1.3.6 Inexact Result (Precision) Exception (#P) 


The inexact-result exception (also called the precision exception) occurs if the result of an operation is not exactly 
representable in the destination format. For example, the fraction 1/3 cannot be precisely represented in binary 
form. This exception occurs frequently and indicates that some (normally acceptable) accuracy has been lost. 
The exception is supported for applications that need to perform exact arithmetic only. In flush-to-zero mode, 
the inexact result exception is signaled for any tiny result. (By definition, tiny results are not zero, and are flushed 
to zero when MXCSR.FZ = 1 for all instructions that support this mode.) 


Note that inexact exceptions (like all other floating-point exceptions) are always masked in the Intel® Xeon Phi” 
coprocessor. 


4.2 Denormal Flushing Control 


4.2.1 Denormal control in up-conversions and down-conversions 


Instruction up-conversions and down-conversions follow specific denormal flushing rules, i.e. for treating input 
denormals as zeros and for flushing tiny results to zero: 


4.2.1.1 Up-conversions 


¢ Up-conversions from float16 to float32 ignore the MXCSR.DAZ setting and this never treat input denormals 
as zeros. Denormal exceptions are never signaled (the MXCSR.DE flag is never set by these operations). 


¢ Up-conversions from any small floating-point number (namely, float16) to float32 can never generate a 
float32 output denormal 
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4.2.1.2 Down-conversions 


¢ Down-conversions from float32 to float16 follow the MXCSR.DAZ setting to decide whether to treat input 
denormals as zeros or not. For input denormals, the MXCSR.DE flag is set only if MXCSR.DAZ is not set, 
otherwise it is left unchanged. 


¢ Down-conversions from float32 to any integer format follow the MXCSR.DAZ setting to decide whether to 
treat input denormals as zeros or not (this may matter only in directed rounding modes). The MXCSR.DE 
status flag is never set. 


¢ Down-conversions from float32 to any small floating-point number ignore MXCSR.FZ and always preserve 
output denormals. 


4.3 Extended Addressing Displacements 


Address displacements used by memory operands to the Intel® Xeon Phi” Coprocessor Instruction Set Architec- 
ture vector instructions, as well as MVEX-encoded versions of VPREFETCH and CLEVICT, operate differently than 
do normal x86 displacements. Intel® Xeon Phi” Coprocessor Instruction Set Architecture 8-bit displacements (i.e. 
when MOD.mod=01) are reinterpreted so that they are multiplied by the memory operand's total size in order 
to generate the final displacement to be used in calculating the effective address (32 bit displacements, which 
vector instructions may also use, operate normally, in the same way as for normal x86 instructions). Note that 
extended 8-bit displacements are still signed integer numbers and need to be sign extended. 


A given vector instruction's 8-bit displacement is always multiplied by the total number of bytes of memory 
the instruction accesses, which can mean multiplication by 64, 32, 16, 8, 4, 2 or 1, depending on any broadcast 
and/or data conversion in effect. Thus when reading a 64-byte (no conversion, no broadcast) source operand, 
for example via 


vmovaps zmm0, [rsi] 


the encoded 8-bit displacement is first multiplied by 64 (shifted left by 6) before being used in the effective 
address calculation. For 


vbroadcastss zmmO, [rsi] {uint16} // {1to16} broadcast of {uint16} data 


however, the encoded displacement would be multiplied by 2. Note that for MVEX versions of VPREFETCH and 
CLEVICT, we always use disp8*64; for VEX versions we use the standard x86 disp8 displacement. 


The use of disp8*N makes it possible to avoid using 32 bit displacements with vector instructions most of the 
time, thereby reducing code size and shrinking the required size of the paired-instruction decode window by 
3 bytes. Disp8*N overcomes disp8 limitations, as it is simply too small to access enough vector operands to 
be useful (only 4 64-byte operands). Moreover, although disp8*N can only generate displacements that are 
multiples of N, that's not a significant limitation, since Intel® Xeon Phi” Coprocessor Instruction Set Architecture 
memory operands must already be aligned to the total number of bytes of memory the instruction accesses in 
order to avoid raising a #GP fault, and that alignment is exactly what disp8*N results in, given aligned base+index 
addressing. 
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4.4 Swizzle/up-conversion exceptions 


There is a set of the Intel® Xeon Phi’ Coprocessor Instruction Set Architecture that do not accept all regular forms 
of memory up-conversion/register swizzling and raise a #UD fault for illegal combinations. The instructions 
are: 


e VALIGND 


VCVTDQ2PD 
VCVTPS2PD 


VCVTUDQ2PD 
VEXP223PS 


e VFMADD233PS 


e VLOG2PS 


e VPERMD 


VPERMF32X4 


e VPMADD233D 


e VPSHUFD 


e VRCP23PS 


VRSQRT23PS 


Table 4.2 summarizes which up-conversion /swizzling primitives are allowed for every one of those instructions: 


Register Memory 
Mnemonic None | {1to16} | {4to16} | swizzles | Conversions 
VALIGND yes no no no no 
VCVTDQ2PD yes yes yes yes no 
VCVTPS2PD yes yes yes yes no 
VCVTUDQ2PD yes yes yes yes no 
VEX223PS yes no no no no 
VFMADD233PS yes no yes no no 
VLOG2PS yes no no no no 
VPERMD yes no no no no 
VPERMF32X4 yes no no no no 
VPMADD233D yes no yes no no 
VPSHUFD yes no no no no 
VRCP23PS yes no no no no 
VRSQRT23PS yes no no no no 


Table 4.2: Summary of legal and illegal swizzle/conversion primitives for special instructions. 
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4.5 Accessing uncacheable memory 


When accessing non cacheable memory, it's important to define the amount of data that is really accessed when 
using Intel® Xeon Phi” Coprocessor Instruction Set Architecture (mainly when Intel® Xeon Phi” Coprocessor In- 
struction Set Architecture instructions are used to access to memory mapped I/O regions). Depending on the 
memory region accessed, an access may cause that a mapped device behave differently. 


Intel® Xeon Phi” Coprocessor Instruction Set Architecture, when accessing to uncacheable memory access, can be 
categorized in four different groups: 

¢ regular memory read operations 

¢ vloadunpackh*/vloadunpackl* 

¢ vgatherd* 


* memory store operations 


4.5.1 Memory read operations 


Any Intel® Xeon Phi” Coprocessor Instruction Set Architecture that read from memory, apart from vloadun- 
packh*/vloadunpackl* and vgatherd, access as many consecutive bytes as dictated by the combination of mem- 
ory SwizzUpConv modifiers. 


4.5.2 vloadunpackh*/vioadunpackl* 


vloadunpackh*/vloadunpack1* instructions are exceptions to the general rule. Those two instructions will 
always access 64 bytes of memory. The memory region accessed is between effective_address & ( Ox3F) and 
(effective_address & ( Ox3F)) + 63 in both cases. 


4.5.3 vgatherd* 


vgatherd instructions are able to gather to up to 16 32 bit elements. The amount of elements accessed is deter- 
mined by the number of bits set in the vector mask provided as source. Vgatherd* instruction will access up to 16 
different 64-byte memory regions when gathering the elements. Note that, depending on the implementation, 
only one 64-byte memory access is performed for a variable number of vector elements located in that region. 


Each accessed regions will be between element_effective_address & ( Ox3F) and (element_effective_address & 
( Ox3F)) + 63. 


4.5.4 Memory stores 


All Intel® Xeon Phi™ Coprocessor Instruction Set Architecture that perform memory store operations, update those 
memory positions determined by the vector mask operand. Vector mask specifies which elements will be actu- 
ally stored in memory. DownConv* determine the number of bytes per element that will be modified in memory. 
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4.6 Floating-point Notes 


4.6.1 Rounding Modes 


VRNDFXPNTPS and conversion instructions with float32 sources, such as VCVTFXPNTPS2DQ, support four se- 
lectable rounding modes: round to nearest (even), round toward negative infinity (round down), round toward 
positive infinity (round up), and round toward zero, These are the standard IEEE rounding modes; see IA-32 
Intel® Architecture Software Developer's Manual: Volume 1, Section 4.8.4, for details. 


The Intel® Xeon Phi” coprocessor introduces general support for all four rounding-modes mandated for binary 
floating-point arithmetic by the IEEE Standard 754-2008. 


4.6.1.1 Swizzle-explicit rounding modes 


The Intel® Xeon Phi” coprocessor introduces the option of specifying the rounding-mode per instruction via a 
specific register swizzle mode (by setting the EH bit to 1). This specific rounding-mode takes precedence over 
whatever MXCSR.RC specifies. 


For those instructions (like VRNDFXPNTPS) where an explicit rounding-mode is specified via immediate, this 
immediate takes precedence over a swizzle-explicit rounding-mode embedded into the encoding of the instruc- 
tion. 


The priority of the rounding-modes of an instruction hence becomes (from highest to lowest): 


1. Rounding mode specified in the instruction immediate (if any) 
2. Rounding mode specified is the instruction swizzle attribute 


3. Rounding mode specified in RC bits of the MXCSR 


4.6.1.2 Definition and propagation of NaNs 


The IA-32 architecture defines two classes of NaNs: quiet NaNs (QNaNs) and signaling NaNs (SNaNs). Quiet 
NaNs have 1 as their first fraction bit, SNaNs have 0 as their first fraction bit. An SNaN is quieted by setting its 
first first fraction bit to 1. The class of a NaN (quiet or signaling) is preserved when converting between different 
precisions. 


The processor never generates an SNaN as a result of a floating-point operation with no SNaN operands, so 
SNaNs must be present in the input data or have to be inserted by the software. 


QNaNs are allowed to propagate through most arithmetic operations without signaling an exception. Note also 
that Intel® Xeon Phi” Coprocessor Instruction Set Architecture instructions do not trap for arithmetic exceptions, 
as floating-point exceptions are always masked. 


If any operation has one or more NaN operands then the result, in most cases, is a QNaN that is one of the input 
NaNs, quieted if it is an SNaN. This is chosen as the first NaN encountered when scanning the operands from left 
to right, as presented in the instruction descriptions from Chapter 6. 


If any floating-point operation with operands that are not NaNs leads to an indefinite result (e.g. 0/0, 0 x 00, or 
oo — ov), the result will be QNaN Indefinite: OxFFC00000 for 32 bit operations and OxFFF8000000000000 for 
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64 bit operations. 


When operating on NaNs, if the instruction does not define any other behavior, Table 4.3 describes the NaN 
behavior for unary and binary instructions. Table 4.4 shows the NaN behavior for ternary fused multiply and 
add/sub operations. This table can be derived by considering the operation as a concatenation of two binary op- 
erations. The first binary operation, the multiply, produces the product. The second operation uses the product 
as the first operand for the addition. 


Source operands Result 

SNaN SNaN source operand, converted into a QNaN 

QNaN QNaN source operand 

SNaN and QNaN First operand (if this operand is an SNaN, it is con- 
verted to a QNaN) 

Two SNaNs First operand converted to a QNaN 

Two QNaNs First operand 

SNaN and a floating-point value SNaN source operand, converted into a QNaN 

QNaN and a floating-point value QNaN source operand 


Table 4.3: Rules for handling NaNs for unary and binary operations. 


4.6.1.3. Signed Zeros 


Zero can be represented as a +0 or a —0 depending on the sign bit. Both encodings are equal in value. The sign 
of a zero result depends on the operation being performed and the rounding mode being used. 


Intel® Xeon Phi” Coprocessor Instruction Set Architecture introduces the fused "multiply and add" and "multiply 
and sub" operations. These consist of a multiplication (whose sign is possibly negated) followed by an addition 
or subtraction, all calculated with just one rounding error. 


The sign of the multiplication result is the exclusive-or of the signs of the multiplier and multiplicand, regardless 
of the rounding mode (a positive number has a sign bit of 0, and a negative one, a sign bit of 1). 


The sign of the addition (or subtraction) result is in general that of the exact result. However, when this result 
is exactly zero, special rules apply: when the sum of two operands with opposite signs (or the difference of two 
operands with like signs) is exactly zero, the sign of that sum (or difference) is +0 in all rounding modes, except 
round down; in that case, the sign of an exact zero sum (or difference) is —0. This is true even if the operands 
are zeros, or denormals treated as zeros because MXCSR.DAZ is set to 1. Note that x + « = 2 — (—z) retains the 
same sign as x even when x is zero; in particular, (+0) + (+0) = +0, and (—0) + (—0) = —0O, in all rounding 
modes. 


When (a x b) + cis exactly zero, the sign of fused multiply-add/subtract shall be determined by the rules above 
for a sum of operands. When the exact result of +(a x b) + cis non-zero yet the final result is zero because of 
rounding, the zero result takes the sign of the exact result. 


The result for "fused multiply and add" follows by applying the following algorithm: 


© (Xa, Ya; Za) =DAZ applied to (Src1, Sre2, Src3) (denormal operands, if any, are treated as zeros of the same 
sign as the operand; other operands are not changed) 


¢ Resultg = Xa X Ya + Za computed exactly then rounded to the destination precision. 
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e Result = FTZ applied to Result, (tiny results are replaced by zeros of the same sign; other results are not 
changed). 


4.6.2 REX prefix and Intel’ Xeon Phi Coprocessor Instruction Set Architecture inter- 
actions 


The REX prefix is illegal in combination with Intel® Xeon Phi” Coprocessor Instruction Set Architecture vector 
instructions, or with mask and scalar instructions allocated using VEX and MVEX prefixes. 


Following the Intel® 64 behavior, if the REX prefix is followed with any legacy prefix and not located just before 
the opcode escape, it will be ignored. 


4.7 Intel’ Xeon Phi Coprocessor Instruction Set Architecture State 
Save 


The Intel® Xeon Phi” coprocessor does not include any explicit instruction to perform context save and restore 
of the Intel® Xeon Phi” coprocessor state. To perform a context save and restore we may use: 


e Vector loads and stores for vector registers 
e¢ Acombination of kmov plus scalar loads and stores for mask registers 


e LDMXCSR/STMXCSR for the MXCSR state register 


Note also that vector instructions raise a device-not-available (#NM) exceptions when CRO.TS is set. This allows 
to perform selective lazy save and restore of state. 


4.8 Intel Xeon Phi Coprocessor Instruction Set Architecture Processor 
State After Reset 


Table 4.5 shows the state of the flags and other registers following power-up for the Intel® Xeon Phi” coproces- 
sor. 
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Register Intel® Xeon Phi” coprocessor 
EFLAGS 00000002H 

EIP OOOOFFFOH 

CRO 60000010H2 

CR2, CR3, CR4 00000000H 

cs Selector = FOOOH; Base = FFFFOOO0H 


Limit = FFFFH 
AR = Present, R/W, Accessed 


SS, DS, ES, FS, GS 


Selector = 0000H; Base = 00000000H 
Limit = FFFFH 
AR = Present, R/W, Accessed 


EDX 000005xxH 

EAX 04 

EBX, ECX, ESI, EDI, EBP, ESP 00000000H 

STO through ST7 Pwr up or Reset: +0.0 
FINIT/FNINIT: Unchanged 

x87 FPU Control Word Pwr up or Reset: 0040H 
FINIT/FNINIT: 037FH 

x87 FPU Status Word Pwr up or Reset: 0000H 
FINIT/FNINIT: 0000H 

x87 FPU Tag Word Pwr up or Reset: 5555H 


FINIT/FNINIT: FFFFH 


x87 FPU Data Operand and CS 
Seg. Selectors 


Pwr up or Reset: 0000H 
FINIT/FNINIT: 0000H 


x87 FPU Data Operand and Pwr up or Reset: 00000000H 

Inst. Pointers FINIT/FNINIT: 00000000H 

MMO through MM7 NA 

XMMO0 through XMM7 NA 

k0 through k7 0000H 

zmm0 through zmm31 0 (64 bytes) 

MXCSR 0020_0000H 

GDTR, IDTR Base = 00000000H, Limit = FFFFH 


AR = Present, R/W 


LDTR, Task Register 


Selector = 0000H, Base = 00000000H 
Limit = FFFFH 
AR = Present, R/W 


DRO, DR1, DR2, DR3 00000000H 
DR6 FFFFOFFOH 
DR7 00000400H 


Time-Stamp Counter 


Power up or Reset: 0H 
INIT: Unchanged 


Perf. Counters and Event Select 


Power up or Reset: 0H 
INIT: Unchanged 


All Other MSRs 


Power up or Reset: Undefined 
INIT: Unchanged 


Data and Code Cache, TLBs 


Invalid 


MTRRs, Machine-Check 


Not Implemented 


APIC 


Pwr up or Reset: Enabled 
INIT: Unchanged 


Table 4.5: Processor State Following Power-up, Reset, or INIT. 
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Chapter 5 


Instruction Set Reference 


Intel® Xeon Phi” Coprocessor Instruction Set Architecture that are described in this document follow the general 
documentation convention established in this chapter. 


5.1 Interpreting Instruction Reference Pages 


This section describes the format of information contained in the instruction reference pages in this chapter. It 
explains notational conventions and abbreviations used in these sections 


5.1.1. Instruction Format 


The following is an example of the format used for each instruction description in this chapter. 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.W1 50 /r vaddnpd zmm1 k1, zmm2, Srg4(zmm3/m;) Add _ float64 vector 
zmmz2 and float64 vector 
Sf64(zmm3/mt), negate 
the sum, and store the 
result in zmm1i1, under 
write-mask. 

VEX.OF.WO 41 /r kand k1 , k2 Perform a bitwise AND 
between k1 and k2, store 
result in k1 


5.1.2 Opcode Notations for MVEX Encoded Instructions 


In the Instruction Summary Table, the Opcode column presents the details of each instruction byte encoding 
using notations described in this section. For MVEX encoded instructions, the notations are expressed in the 
following form (including the modR/M byte if applicable, and the immediate byte if applicable): 
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MVEX. [NDS,NDD]. [512] . [66,F2,F3] .OF/OF3A/0F38.[WO,W1] opcode [/r] [/ib] 


e MVEX: indicates the presence of the MVEX prefix is required. The MVEX prefix consists of 4 bytes with the 
leading byte 62H. 
The encoding of various sub-fields of the MVEX prefix is described using the following notations: 


NDS,NDD: specifies that MVEX.vvwv field is valid for the encoding of a register operand: 


* MVEX.NDS: MVEX.vvwv encodes the first source register in an instruction syntax where the con- 
tent of source registers will be preserved. To encode a vector register in the range zmm16- 
zmm31, the MVEX.vvwv field is pre-pended with MVEX.V'. 

* MVEX.NDD: MVEX.vvwv encodes the destination register that cannot be encoded by ModR/M:reg 
field. To encode a vector register in the range zmm16-zmm31, the MVEX.vvwv field is pre-pended 
with MVEX.V’. 

* If none of NDS, NDD is present, MVEX.vvvv must be 1111b (i.e. MVEX.vvvv does not encode an 
operand). 

66,F2,F3: The presence or absence of these value maps to the MVEX.pp field encodings. If absent, 
this corresponds to MVEX.pp=OOB. If present, the corresponding MVEX.pp value affects the "opcode" 
byte in the same way as if a SIMD prefix (66H, F2H or F3H) does to the ensuing opcode byte. Thus a 
non-zero encoding of MVEX.pp may be considered as an implied 66H/F2H/F3H prefix. 


OF OF3A,0F38: The presence of these values maps to a valid encoding of the MVEX.mmmm field. Only 
three encoded values of MVEX.mmmm are defined as valid, corresponding to the escape byte se- 
quence of OFH, OF3AH and OF38H. 

W0: MVEX.W=0 

W1: MVEX.W=1 

The presence of W0O/W1 in the opcode column applies to two situations: (a) it is treated as an ex- 
tended opcode bit, (b) the instruction semantics support an operand size promotion to 64 bit of a 
general-purpose register operand or a 32 bit memory operand. 


¢ opcode: Instruction opcode. 


e /r: Indicates that the ModR/M byte of the instruction contains a register operand and an r/m operand. 


e /vsib: Indicates the memory addressing uses the vector SIB byte. 


e ib: A1-byte immediate operand to the instruction that follows the opcode, ModR/M bytes or scale/indexing 
bytes. 


In general, the encoding of the MVEX.R, MVEX.X, MVEX.B, and MVEX.V' fields are not shown explicitly in the 
opcode column. The encoding scheme of MVEX.R, MVEX.X, MVEX.B, and MVEX.V' fields must follow the rules 
defined in Chapter 3. 


5.1.3. Opcode Notations for VEX Encoded Instructions 


In the Instruction Summary Table, the Opcode column presents the details of each instruction byte encoding 
using notations described in this section. For VEX encoded instructions, the notations are expressed in the fol- 
lowing form (including the modR/M byte if applicable, the immediate byte if applicable): 


VEX. [NDS ,NDD] . [66 ,F2,F3] .OF/OF3A/0F38.[WO,W1] opcode [/r] [/ib] 
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VEX: indicates the presence of the VEX prefix is required. The VEX prefix can be encoded using the 
three-byte form (the first byte is C4H), or using the two-byte form (the first byte is CSH). The two-byte 
form of VEX only applies to those instructions that do not require the following fields to be encoded: 
VEX.mmmmm, VEX.W, VEX.X, VEX.B. Refer to Chapter 3 for more details on the VEX prefix. 

The encoding of various sub-fields of the VEX prefix is described using the following notations: 


- NDS,NDD: specifies that VEX.vvvv field is valid for the encoding of a register operand: 


* VEX.NDS: VEX.vvvv encodes the first source register in an instruction syntax where the content 
of source registers will be preserved. 

* VEX.NDD: VEX.vvvv encodes the destination register that cannot be encoded by ModR/M:reg 
field. 

* If none of NDS, NDD is present, VEX.vvvv must be 1111b (i.e. VEX.vvvv does not encode an 
operand). The VEX.vvwv field can be encoded using either the 2-byte or 3-byte form of the VEX 
prefix. 


- 66,F2,F3: The presence or absence of these value maps to the VEX.pp field encodings. If absent, this 
corresponds to VEX.pp=OOB. If present, the corresponding VEX.pp value affects the "opcode" byte in 
the same way as if aSIMD prefix (66H, F2H or F3H) does to the ensuing opcode byte. Thus a non-zero 
encoding of VEX.pp may be considered as an implied 66H/F2H/F3H prefix. The VEX.pp field may be 
encoded using either the 2-byte or 3-byte form of the VEX prefix. 


- OFOF3A,0F38: The presence of these values maps to a valid encoding of the VEX.mmmmm field. Only 
three encoded values of VEX.mmmmm are defined as valid, corresponding to the escape byte se- 
quence of OFH, OF3AH and OF38H. The effect of a valid VEX.mmmmm encoding on the ensuing opcode 
byte is same as if the corresponding escape byte sequence on the ensuing opcode byte for non-VEX 
encoded instructions. Thus a valid encoding of VEX.mmmmm may be consider as an implies escape 
byte sequence of either OFH, OF3AH or OF38H. The VEX.mmmmzm field must be encoded using the 
3-byte form of VEX prefix. 


- OFOF3A,0F38 and 2-byte/3-byte VEX: The presence of OF3A and OF38 in the opcode column implies 
that opcode can only be encoded by the three-byte form of VEX. The presence of OF in the opcode 
column does not preclude the opcode to be encoded by the two-byte of VEX if the semantics of the 
opcode does not require any subfield of VEX not present in the two-byte form of the VEX prefix. 

- WO: VEX.W=0 

- W1:; VEX.W=1 

- The presence of W0/W1 in the opcode column applies to two situations: (a) it is treated as an ex- 
tended opcode bit, (b) the instruction semantics support an operand size promotion to 64 bit of a 
general-purpose register operand or a 32 bit memory operand. The presence of W1 in the opcode 
column implies the opcode must be encoded using the 3-byte form of the VEX prefix. The presence 
of WO in the opcode column does not preclude the opcode to be encoded using the C5H form of the 
VEX prefix, if the semantics of the opcode does not require other VEX subfields not present in the 
two-byte form of the VEX prefix. 


opcode: Instruction opcode. 
/v: Indicates that the ModR/M byte of the instruction contains a register operand and an r/m operand. 


ib: A1-byte immediate operand to the instruction that follows the opcode, ModR/M bytes or scale/indexing 
bytes. 


In general, the encoding of the VEX.R, VEX.X, and VEX.B fields are not shown explicitly in the opcode col- 
umn. The encoding scheme of VEX.R, VEX.X, and VEX.B fields must follow the rules defined in Chapter 
3. 
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Chapter 6 


Instruction Descriptions 


This Chapter defines all of the Intel® Xeon Phi” Coprocessor Instruction Set Architecture vector instructions. Note: 
Some instruction descriptions refer to the SS'S or 525,59, which are bits 6-4 from the MVEX prefix encoding. 
See Table 2.14 for more details 
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JKNZD - Jump near if mask is not zero 


Opcode Instruction Description 

VEX.NDS.128.0F.WO 85 id jknzd k1, rel32 Jump near if mask is not zero. 

VEX.NDS.128.W0 75 ib jknzd k1, rel8 Jump near if mask is not zero. 
Description 


Checks the value of source mask, and if not all mask bits are set to 0, performs a jump to 
the target instruction specified by the destination operand. If the condition is not satis- 
fied, the jump is not performed and execution continues with the instruction following 
the instruction. 


The target instruction is specified with a relative offset (a signed offset relative to the 
current value of the instruction pointer in the EIP register). A relative offset (rel8, rel16, 
or rel32) is generally specified as a label in assembly code, but at the machine code level, 
itis encoded as a signed, 8-bit or 32 bit immediate value, which is added to the instruction 
pointer. Instruction coding is most efficient for offsets of -128 to +127. Ifthe operand-size 
attribute is 16, the upper two bytes of the EIP register are cleared, resulting ina maximum 
instruction pointer size of 16 bits. 


The instruction does not support far jumps (jumps to other code segments). When the 
target for the conditional jump is in a different segment, use the opposite condition from 
the condition being tested for the JKNZD instruction, and then access the target with an 
unconditional far jump (JMP instruction) to the other segment. For example, the following 
conditional far jump is illegal: 


JKNZD FARLABEL; 
To accomplish this far jump, use the following two instructions: 


JKZD BEYOND; 
JMP FARLABEL; 
BEYOND: 


This conditional jump is converted to code fetch of one or two cache lines, regardless of 
jump address or cacheability. 


In 64 bit mode, operand size (OSIZE) is fixed at 64 bits. JMP Short is RIP = RIP + 8-bit 
offset sign extended to 64 bits. JMP Near is RIP = RIP + 32 bit offset sign extended to 64 
bits. 
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Operation 


if (k1[15:0] !=0) 
{ 
tempEIP = EIP + SignExtend (DEST) ; 


if (OSIZE == 16) 
{ 
tempEIP = tempEIP & OOOOFFFFH; 
} 
if (*tempEIP is not within code segment limit*) 
{ 
#GP (0) ; 
} 


else 


{ 
EIP = tempEIP 
} 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


None. 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#GP(0) If the memory address is in a non-canonical form. 
#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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JKZD - Jump near if mask is zero 


Opcode Instruction Description 

VEX.NDS.128.0F. WO 84 id jkzd k1, rel32 Jump near if mask is zero. 

VEX.NDS.128.W0 74 ib jkzd k1, rel8 Jump near if mask is zero. 
Description 


Checks the value of source mask, and if all mask bits are set to 0, performs a jump to the 
target instruction specified by the destination operand. If the condition is not satisfied, 
the jump is not performed and execution continues with the instruction following the in- 
struction. 


The target instruction is specified with a relative offset (a signed offset relative to the 
current value of the instruction pointer in the EIP register). A relative offset (rel8, rel16, 
or rel32) is generally specified as a label in assembly code, but at the machine code level, 
itis encoded as a signed, 8-bit or 32 bit immediate value, which is added to the instruction 
pointer. Instruction coding is most efficient for offsets of -128 to +127. Ifthe operand-size 
attribute is 16, the upper two bytes of the EIP register are cleared, resulting ina maximum 
instruction pointer size of 16 bits. 


The instruction does not support far jumps (jumps to other code segments). When the 
target for the conditional jump is in a different segment, use the opposite condition from 
the condition being tested for the JKNZD instruction, and then access the target with an 
unconditional far jump (JMP instruction) to the other segment. For example, the following 
conditional far jump is illegal: 


JKZD FARLABEL; 
To accomplish this far jump, use the following two instructions: 


JKNZD BEYOND; 
JMP FARLABEL; 
BEYOND: 


This conditional jump is converted to code fetch of one or two cache lines, regardless of 
jump address or cacheability. 


In 64 bit mode, operand size (OSIZE) is fixed at 64 bits. JMP Short is RIP = RIP + 8-bit 
offset sign extended to 64 bits. JMP Near is RIP = RIP + 32 bit offset sign extended to 64 
bits. 
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Operation 


if (k1[15:0]==0) 
{ 
tempEIP = EIP + SignExtend (DEST) ; 


if (OSIZE == 16) 
{ 
tempEIP = tempEIP & OOOOFFFFH; 
} 
if (*tempEIP is not within code segment limit*) 
{ 
#GP (0) ; 
} 


else 


{ 
EIP = tempEIP 
} 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


None. 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#GP(0) If the memory address is in a non-canonical form. 
#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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KAND - AND Vector Mask 


Opcode Instruction Description 
VEX.128.0F.WO 41 /r kand k1, k2 Perform a bitwise AND between vector masks 
k1 and k2 and store the result in vector mask 
k1. 
Description 


Performs a bitwise AND between the vector masks k2 and the vector mask k1, and writes 


the result into vector mask k1. 


Operation 


for (n = 0; n < 16; n++) { 
ki{m] = ki[n] & k2[n] 
} 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_mmask16 _mm512_kand (_mmask16,__mmask16); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 


#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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KANDN - AND NOT Vector Mask 


Opcode Instruction Description 
VEX.128.0F.WO 42 /r kandn k1, k2 Perform a bitwise AND between NOT (vector 
mask k1) and vector mask k2 and store the re- 
sult in vector mask k1. 
Description 


Performs a bitwise AND between vector mask k2, and the NOT (bitwise logical negation) 


of vector mask k1, and writes the result into vector mask k1. 


Operation 


for (n = 0; n < 16; n++) { 
ki({n] = (~(kiln])) & k2[n] 
} 


Flags Affected 
None. 
Intel’ C/C++ Compiler Intrinsic Equivalent 
_mmask16 _mm512_kandn (_mmask16,__mmask16); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 


#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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KANDNR - Reverse AND NOT Vector Mask 


Opcode Instruction Description 

VEX.128.0F.WO 43 /r kandnr k1, k2 Perform a bitwise AND between NOT (vector 
mask k2) and vector mask k1 and store the re- 
sult in vector mask k1. 


Description 


Performs a bitwise AND between the NOT (bitwise logical negation) of vector mask k2, 
and the vector mask k1, and writes the result into vector mask k1. 


Operation 


for (n = 0; n < 16; n++) { 
ki{n] = ~(k2[n]) & ki[n) 
} 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—mmask16 _mm512_kandnr (_mmask16, __mmask16); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 


#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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KCONCATH - Pack and Move High Vector Mask 


Opcode Instruction Description 
VEX.NDS.128.0FW0 95 /r_ kconcath r64,k1,k2 Concatenate vector masks k1 and k2 into the high part 
of register r64. 


Description 


Packs vector masks k1 and k2 and moves the result to the high 32 bits of destination reg- 
ister r64. The rest of the destination register is zeroed. 


Operation 


TMP([15:0] = k2[15:0] 
TMP [31:16] = ki[15:0] 
r64[31:0] = 0 
r64[63:32] = TMP 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_int64 _mm512_kconcathi_64(_mmask16, _mmask16); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If destination is a memory operand. 
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KCONCATL - Pack and Move Low Vector Mask 


Opcode Instruction Description 


register r64. 


VEX.NDS.128.0FW0 97 /r kconcatl r64,k1,k2 Concatenate vector masks k1 and k2 into the low part of 


Description 


Packs vector masks k1 and k2 and moves the result to the low 32 bits of destination reg- 


ister r64. The rest of the destination register is zeroed. 
Operation 


TMP([15:0] = k2[15:0] 
TMP [31:16] = k1i[15:0] 
r64[31:0] = TMP 
r64[63:32] = 0 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_int64 _mm512_kconcatlo_64(_mmask16, _mmask16); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If destination is a memory operand. 
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KEXTRACT - Extract Vector Mask From Register 


Opcode Instruction Description 
VEX.128.66.0F3A.WO 3E /rib  kextractk1,r64,imm8 Extract field from general purpose register r64 
into vector mask k1 using imm8. 


Description 


Extract the 16-bit field selected by imm8[1:0] from general purpose register r64 and write 


the result into destination mask register k1. 
Operation 
index = imm8[1:0] * 16 


k1[15:0] = r64[index+15: index] 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_mmask16 _mm512_kextract_64(__int64, const in); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If source is a memory operand. 
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KMERGE2L1H - Swap and Merge High Element Portion and Low Portion of 
Vector Masks 


Opcode Instruction Description 
VEX.128.0F.W0 48 /r kmerge2l1hk1,k2 Concatenate the low half of vector mask k2 and the high half of 
vector mask k1 and store the result in the vector mask k1. 


Description 


Move high element from vector mask register k1 into low element of vector mask register 
k1, and insert low element of k2 into the high portion of vector mask register k1. 


Operation 


tmp = k1i[15:8] 
k1[15:8] = k2[7:0] 
k1[7:0] = tmp 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 
_—mmask16 _mm512_kmerge211h (_mmask16, _mmask16 k2); 
Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 


#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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KMERGE2L1L - Move Low Element Portion into High Portion of Vector 
Mask 


Opcode Instruction Description 
VEX.128.0F.W0 49 /r kmerge2l11k1,k2 Movelowhalfofvector mask k2 into the high half of vector mask 
k1. 
Description 


Insert low element from vector mask register k2 into high element of vector mask register 
k1. Low element of k1 remains unchanged. 


Operation 
k1[15:8] = k2[7:0] 


*k1[7:0] remains unchanged* 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_mmask16 _mm512_kmerge211] (_mmask16, _mmask16 k2); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 


#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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KMOV - Move Vector Mask 


Opcode Instruction Description 

VEX.128.0F.W0 90 /r kmovk1i1, k2 Move vector mask k2 and store the result in k1. 
VEX.128.0F.W0 93 /r kmovr32,k2 Move vector mask k2 to general purpose register r32. 
VEX.128.0F.W0 92 /r kmovki,r32 Move general purpose register r32 to vector mask k1. 


Description 


Either the vector mask register k2 or the general purpose register r32 is read, and its 
contents written into destination general purpose register r32 or vector mask register k1; 
however, general purpose register to general purpose register copies are not supported. 
When the destination is a general purpose register, the 16 bit value that is copied is zero- 
extended to the maximum operand size in the current mode. 


Operation 


if (DEST is a general purpose register) { 
DEST[63:16] = 0 
DEST[15:0] = k2[15:0] 


} else if (DEST is vector mask and SRC is a general purpose register) { 
k1[15:0] = SRC[15:0] 
} else f 
k1[15:0] = k2(15:0] 
} 
Flags Affected 
None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_mmask16 _mm512_kmov (_mmask16); 
_mmask16 _mm512_int2mask (int); 
int _mm512_mask2int (_mmask16); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If source/destination is a memory operand. 
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KNOT - Not Vector Mask 


Opcode Instruction Description 
VEX.128.0F. WO 44 /r knot k1, k2 Perform a bitwise NOT on vector mask k2 and 
store the result in k1. 


Description 


Performs the bitwise NOT of the vector mask k2, and writes the result into vector mask 
k1. 


Operation 


for (n = 0; n < 16; nt+) { 
kifm] = ~ k2[n] 
} 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_mmask16 _mm512_knot(_mmask16); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 


#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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KOR - OR Vector Masks 


Opcode Instruction Description 
VEX.128.0F.WO 45 /r kor k1, k2 vector masks k1 and k2 and store the result in 
vector mask k1. 
Description 


Performs a bitwise OR between the vector mask k2, and the vector mask k1, and writes 


the result into vector mask k1. 


Operation 


for (n = 0; n < 16; nt+) { 
ki[n] = ki[m) | k2[n] 
} 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—mmask16 _mm512_kor(_mmask16,__mmask16); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 


#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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KORTEST - OR Vector Mask And Set EFLAGS 


Opcode Instruction Description 
VEX.128.0F.WO 98 /r kortest k1, k2 vector masks k1 and k2 and update ZF and CF 
EFLAGS accordingly. 
Description 


Performs a bitwise OR between the vector mask register k2, and the vector mask register 
k1, and sets CF and ZF based on the operation result. 


ZF flag is set if both sources are 0x0. CF is set if, after the OR operation is done, the oper- 
ation result is all 1's. 


Operation 
OF =i 
ZP = 4 


for (n = 0; n < 16; n++) f{ 
tmp = (ki[n] | k2[n]) 
ZF & (tmp == 0x0) 

CF & (tmp == 0x1) 

} 


Flags Affected 


¢ The ZF flag is set if the result of OR-ing both sources is all Os 
¢ The CF flag is set if the result of OR-ing both sources is all 1s 
e The OF SF AF, and PF flags are set to 0. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


int _mm512_kortestz (_mmask16,__mmask16); 
int _mm512_kortestc (_mmask16,__mmask16); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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KXNOR - XNOR Vector Masks 


Opcode Instruction Description 
VEX.128.0F. WO 46 /r kxnor k1, k2 vector masks k1 and k2 and store the result in 
vector mask k1. 


Description 


Performs a bitwise XNOR between the vector mask k1 and the vector mask k2, and the 
result is written into vector mask k1. 


The primary purpose of this instruction is to provide a way to set a vector mask register 
to OxFFFF in a single clock; this is accomplished by selecting the source and destination to 
be the same mask register. In this case the result will be OxFFFF regardless of the original 
contents of the register. 


Operation 


for (n = 0; n < 16; n++) { 
kifn) = ~(ki[m] ~*~ k2[n]) 
} 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—mmask16 _mm512_kxnor (_mmask16,__mmask16); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 
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#UD Instruction not available in these modes 
64 bit Mode 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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KXOR - XOR Vector Masks 


Opcode Instruction Description 
VEX.128.0F.WO 47 /r kxor k1, k2 vector masks k1 and k2 and store the result in 
vector mask k1. 
Description 


Performs a bitwise XOR between the vector mask k2, and the vector mask k1, and writes 


the result into vector mask k1. 


Operation 


for (n = 0; n < 16; nt+) { 
kifn) = ki[n] ~*~ k2[n] 
} 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—mmask16 _mm512_kxor (_mmask16,__mmask16); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 


#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VADDNPD - Add and Negate Float64 Vectors 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.W1 vaddnpd zmm1 {k1}, zmm2, Add float64 vector zmm2 and float64 vector 
50 /r S'rga(zmm3/m_) S'rea(zmm3/m,), negate the sum, and store the 
result in zmm1, under write-mask. 
Description 


Performs an element-by-element addition between float64 vector zmm2 and the float64 
vector result of the swizzle/broadcast/conversion process on memory or float64 vector 
zmm3, then negates the result. The final result is written into float64 vector zmm1. 


Note that all the operations must be performed before rounding. 


xy RN/RU/RZ 


+0 +0 |) (-0) +(-0) =-0 | (-0) 
+0 -0 |[ (0) +(+0) =+0/ (0) 
-0 +0 |[ (+0) +(-0) =+0 | (+0) 
0 -0 || 40) +(+0) =+0 | (+0) 


RD 
+(-0) =-0 
+(+0) =-0 
+(-0) =-0 
+(+0) =+0 


Table 6.1: VADDN outcome when adding zeros depending on rounding-mode. See Signed Zeros in Section 4.6.1.3 
for other cases with a result of zero. 


108 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 


RoundingMode = SSS[1:0] 

tmpSrc3[511:0] = zmm3[511:0] 
} else { 

RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad fe4 (zmm3/m) 


} 


for (n = 0; n < 8; nt++) f{ 
if(kifm] != 0) f 
i = 64*n 
// float64 operation 


zmm1[i+63:i] = (-zmm2[i+63:i]) + (-tmpSrc3[i+63:i]) 


} 
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SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512d _mm512_addn_pd(_m512d,__m512d); 
_—m512d _mm512_mask_addn_pd(_m512d,_mmask8,_m512d,_m512d); 


Memory Up-conversion: S ¢4 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Register Swizzle: S ¢¢4 


MVEX.EH=0 

S25S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 

Exceptions 
Real-Address Mode and Virtual-8086 
#UD Instruction not available in these modes 
Protected and Compatibility Mode 
#UD Instruction not available in these modes 


64 bit Mode 
#SS(0) 


#GP(0) 


If a memory address referencing the SS segment is 
in a non-canonical form. 
If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
For a page fault. 
If CRO.TS[bit 3]=1. 


#PF(fault-code) 
#NM 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VADDNPS - Add and Negate Float32 Vectors 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.WO vaddnps zmm1 {k1}, zmm2, Add float32 vector zmm2 and float32 vector 
50 /r S'p32(zmm3/m_) S'732(zmm3/m;), negate the sum, and store the 
result in zmm1, under write-mask. 
Description 


Performs an element-by-element addition between float32 vector zmm2 and the float32 
vector result of the swizzle/broadcast/conversion process on memory or float32 vector 
zmm3, then negates the result. The final result is written into float32 vector zmm1. 


Note that all the operations must be performed before rounding. 


xy RN/RU/RZ RD 


+0 +0] (0) +(0) =-0 | (0) +(0) =-0 
+0 -0 || (0) +(+0) =+0 | (0) +(+0) 
-0 +0] (+0) +(-0) =+0 | (+0) +(0) =-0 
-0 -0 (+0) +(4+0) =+0) (+0) +(+0) =+0 


-0 


Table 6.2: VADDN outcome when adding zeros depending on rounding-mode. See Signed Zeros in Section 4.6.1.3 


for other cases with a result of zero. 


This instruction is write-masked, so only those elements with the corresponding bit set 


in vector mask register k1 are computed and stored into zmm1. 


the corresponding bit clear in k1 retain their previous values. 


Operation 


Elements in zmm1 with 


if(source is a register operand and MVEX.EH bit is 1) { 


if (SSS[2]==1) Supress_Exception_Flags() // SAE 


// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 


RoundingMode = SSS[1:0] 

tmpSrc3[511:0] = zmm3[511:0] 
} else { 

RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad f32 (zmm3/m) 


} 


for (n = 0; n < 16; n++) f{ 
if(ki{m] != 0) f{ 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = (-zmm2[it31:i]) + (-tmpSrc3[i+31: 
} 
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} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_addn_ps (_m512,__m512); 
—m512 _mm512_mask_addn_ps (_m512,_mmask16,_m512,__m512); 


Memory Up-conversion: S;35 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 
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Register Swizzle: S35 
MVEX.EH=0 
S25S1Spo || Function: 4 x 32 bits Usage 
000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 
525159 || Rounding Mode Override Usage 
000 Round To Nearest (even) , {rn} 
001 Round Down (-INF) , {rd} 
010 Round Up (+INF) , {ru} 
011 Round Toward Zero , {rz} 
100 Round To Nearest (even) with SAE , {rn-sae} 
101 Round Down (-INF) with SAE , {rd-sae} 
110 Round Up (+INF) with SAE , {ru-sae} 
111 Round Toward Zero with SAE , {rz-sae} 
Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 


#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VADDPD - Add Float64 Vectors 


Opcode Instruction Description 
MVEX.NDS.512.66.0FW1 vaddpd zmm1_ {ki}, zmm2, Add float64 vector zmm2 and float64 vector 
58 /r Sea(zmm3/m+) Sfea4(zmm3/m,) and store the result in zmm1, 
under write-mask. 
Description 


Performs an element-by-element addition between float64 vector zmm2 and the float64 
vector result of the swizzle/broadcast/conversion process on memory or float64 vector 


zmm3. The result is written into float64 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 


the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 


if (SSS[2]==1) Supress_Exception_Flags() // SAE 


// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 


RoundingMode = SSS[1:0] 

tmpSrc3[511:0] = zmm3[511:0] 
} else { 

RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad fe4 (zmm3/m,) 


} 


for (n = 0; n < 8; nt++) f{ 
if(kifm] != 0) f 
i = 64*n 
// float64 operation 
zmm1[i+63:i] = zmm2[i+63:i] + tmpSrc3[it+63:i] 
} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 
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Denormal Handling 
Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512d _mm512_add_pd(_m512d,__m512d); 


—m512d _mm512_mask_add_pd(_m512d,__mmasks8, 


Memory Up-conversion: S ¢4 


_m512d,_m512d); 


S2515Spo || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Reference Number: 327364-001 


115 


CHAPTER 6. INSTRUCTION DESCRIPTIONS 


> 
D 


116 


Register Swizzle: S ¢¢4 


MVEX.EH=0 

S25S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 

Exceptions 
Real-Address Mode and Virtual-8086 
#UD Instruction not available in these modes 
Protected and Compatibility Mode 
#UD Instruction not available in these modes 


64 bit Mode 
#SS(0) 


#GP(0) 


If a memory address referencing the SS segment is 
in a non-canonical form. 
If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
For a page fault. 
If CRO.TS[bit 3]=1. 


#PF(fault-code) 
#NM 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VADDPS - Add Float32 Vectors 


Opcode Instruction Description 
MVEX.NDS.512.0FW058/r vaddps zmm1_ {kl}, zmm2, Add float32 vector zmm2 and float32 vector 
S'p32(zmm3/mz) S'f32(zmm3/m,) and store the result in zmm1, 
under write-mask. 


Description 


Performs an element-by-element addition between float32 vector zmmz2 and the float32 
vector result of the swizzle/broadcast/conversion process on memory or float32 vector 
zmm3. The result is written into float32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad p32 (zmm3/m) 


} 


for (n = 0; n < 16; n++) f{ 
if(kifm] != 0) f 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = zmm2[i+31:i] + tmpSrc3[it31:i] 
} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 
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Denormal Handling 
Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_add_ps (_m512,__m512); 
—m512 _mm512_mask_add_ps (_m512,_mmask16,__m512,__m512); 


Memory Up-conversion: S;35 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 
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Register Swizzle: S35 
MVEX.EH=0 
S25S1Spo || Function: 4 x 32 bits Usage 
000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 
525159 || Rounding Mode Override Usage 
000 Round To Nearest (even) , {rn} 
001 Round Down (-INF) , {rd} 
010 Round Up (+INF) , {ru} 
011 Round Toward Zero , {rz} 
100 Round To Nearest (even) with SAE , {rn-sae} 
101 Round Down (-INF) with SAE , {rd-sae} 
110 Round Up (+INF) with SAE , {ru-sae} 
111 Round Toward Zero with SAE , {rz-sae} 
Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 


#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VADDSETSPS - Add Float32 Vectors and Set Mask to Sign 


Opcode Instruction 


Description 


MVEX.NDS.512.66.0F38.W0 CC /r_ vaddsetsps zmm1 {k1}, zmm2, S'r3o(zmm3/m;) Add float32  vec- 


tor zmm2_ and 
float32 vector 
Sf32(zmm3/m:) 
and store the sum in 
zmm1 and the sign 
from the sum in k1, 
under write-mask. 


Description 


Performs an element-by-element addition between float32 vector zmmz2 and the float32 
vector result of the swizzle/broadcast/conversion process on memory or float32 vector 


zmm3. The result is written into float32 vector zmm1. 


In addition, the sign of the result for the n-th element is written into the n-th bit of vector 


mask k1. 


It is the sign bit of the final result that gets copied to the destination, as opposed to the 


result of comparison with zero. 


This instruction is write-masked, so only those elements with the corresponding bit set in 
vector mask register k1 are computed and stored into zmm1 and k1. Elements in zmm1 
and k1 with the corresponding bit clear in k1 register retain their previous value. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 


if (SSS[2]==1) Supress_Exception_Flags() // SAE 


// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 


RoundingMode = SSS[1:0] 

tmpSrc3[511:0] = zmm3[511:0] 
} else { 

RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad f32 (zmm3/m) 


} 


for (n = 0; n < 16; n++) { 
af Ori [al =. 0) 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = zmm2[i+31:i] + tmpSrc3[it+31:i] 
ki{m] = zmmi[i+31] 
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SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512 _mm512_addsets_ps (_m512,_m512,__mmask16%*); 
—m512 _mm512_mask_addsets_ps (_m512, _mmask16, _m512 , _m512, 
_mmask16*); 


Memory Up-conversion: S ;35 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 
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Register Swizzle: S 3. 


MVEX.EH=0 

S2S1So || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512 _mm512_addsets_ps (_m512,_m512,__mmask16*); 
—m512 _mm512_mask_addsets_ps (_m512, _mmask16, _m512 
_mmask16*); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 


, 


_m512, 
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#GP(0) 


#PF(fault-code) 
#NM 
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in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 


If no write mask is provided or selected write-mask is k0. 
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Opcode Instruction Description 
MVEX.NDS.512.66.0F3A.WO valignd zmmi1 {k1}, zmm2, Shift right and merge vectors zmm2 and 
03 /rib zmm3/m:z, offset zmm3/m, with doubleword granularity using 


offset as number of elements to shift, and store 
the final result in zmm1, under write-mask. 


Description 


Concatenates and shifts right doubleword elements from vector zmm2 and memory/vector 
zmm3. The result is written into vector zmm1. 


No swizzle, broadcast, or conversion is performed by this instruction. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


src[511:0] = zmm3/m; 


// Concatenate sources 
tmp[511:0] = src[511:0] 
tmp[1023:512] = zmm2[511:0] 


// Shift right doubleword elements 
SHIFT = imm8[3:0] 
tmp[1023:0] = tmp[1023:0] >> (32*SHIFT) 


// Apply write-mask 
for (n = 0; n < 16; n++) f{ 
if (ki[m] != 0) f 
i = 32*n 
zmmi[it+31:i] = tmp[i+31:i] 
} 
} 
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Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_alignr_epi32 (_m512i,__m512i, const int); 
—m512i _mm512_mask_alignr_epi32 (_m512i,__mmask16,__m512i,__m512i, const int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 

This instruction does not support any 

SwizzUpConv different from the default value (no broadcast, 
no conversion). If SwizzUpConv function is set to any value 
different than "no action", then an Invalid Opcode fault is 
raised. This includes register swizzles. 
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VBLENDMPD - Blend Float64 Vectors using the Instruction Mask 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.W1 vblendmpd zmm1 {k1}, zmm2, Blend float64 vector zmm2 and float64 vector 

65 /r S'rga(zmm3/m¢) S'rga(zmm3/m,) and store the result in zmm1, 
under write-mask. 


Description 


Performs an element-by-element blending between float64 vector zmm2 and the float64 
vector result of the swizzle/broadcast/conversion process on memory or float64 vector 
zmm3, using the instruction mask as selector. The result is written into float64 vector 
zmm1. 


The mask is not used as a write-mask for this instruction. Instead, the mask is used as an 
element selector: every element of the destination is conditionally selected between first 
source or second source using the value of the related mask bit (0 for first source, 1 for 
second source ). 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 
tmpSrc3[511:0] = tmpSrc3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoad fe4 (tmpSrc3/m,) 

} 


for (n = 0; n < 8; nt+) { 
if (k1[m]==1 or *no write-mask*) { 
zmmi(i+63:i] = tmpSrc3[i+63:i] 
} else f{ 
zmmi[i+63:i] = zmm2[i+63:i] 


} 


SIMD Floating-Point Exceptions 


None. 


126 Reference Number: 327364-001 


(intel. 


CHAPTER 6. INSTRUCTION DESCRIPTIONS 


Denormal Handling 


Treat Input Denormals As Zeros : 


NO 


Flush Tiny Results To Zero : 


NO 


Memory Up-conversion: S ¢4 


525159 || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Register Swizzle: S ¢¢4 


MVEX.EH=0 

S25S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_m512d 


_mm512_mask_blend_pd (_mmask8,_m512d,__m512d); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VBLENDMPS - Blend Float32 Vectors using the Instruction Mask 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.WO vblendmps zmm1 {k1}, zmm2, Blend float32 vector zmm2 and float32 vector 

65 /r S'p32(zmm3/m_) S'f32(zmm3/m,) and store the result in zmm1, 
under write-mask. 


Description 


Performs an element-by-element blending between float32 vector zmm2 and the float32 
vector result of the swizzle/broadcast/conversion process on memory or float32 vector 
zmm3, using the instruction mask as selector. The result is written into float32 vector 
zmm1. 


The mask is not used as a write-mask for this instruction. Instead, the mask is used as an 
element selector: every element of the destination is conditionally selected between first 
source or second source using the value of the related mask bit (0 for first source, 1 for 
second source ). 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = tmpSrc3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoad p32 (tmpSrc3/m,) 

} 


for (n = 0; n < 16; n++) f{ 
if (k1[m]==1 or *no write-mask*) { 
zmmi(i+31:i] = tmpSrc3[i+31:i] 
} else f{ 
zmmi[i+31:i] = zmm2[i+31:i] 


} 


SIMD Floating-Point Exceptions 


Invalid. 
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Denormal Handling 


Treat Input Denormals As Zeros : 
NO 


Flush Tiny Results To Zero : 
NO 


Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 


Register Swizzle: S35 


MVEX.EH=0 

S_5159 || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_mask_blend_ps (_mmask16,__m512,__m512); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 
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Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VBROADCASTF32X4 - Broadcast 4xFloat32 Vector 


Opcode Instruction Description 
MVEX.512.66.0F38.W0 1A vbroadcastf32x4 zmmi_ {k1}, Broadcast 4xfloat32 vector Us32(7mz) into vec- 
/r Us32(mz) tor zmm1, under write-mask. 

Description 


The 4, 8 or 16 bytes (depending on the conversion and broadcast in effect) at memory 
address m; are broadcast and/or converted to a float32 vector. The result is written into 


float32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 


the corresponding bit clear in k1 retain their previous values. 


Operation 


// {4to16} 
tmpSrc2[127:0] = UpConvLoad 32 (mz) 


for (n = 0; n < 16; nt+) { 
if (kim) != 0) { 
i = 32*n 
j = i & Ox7F 
zmmi([i+31:i] = tmpSrc2[j+31:j]) 
} 
} 
Flags Affected 
Invalid. 


Memory Up-conversion: U;3> 


525159 || Function: Usage disp8*N 
000 no conversion [rax] 16 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 float16 to float32 [rax] {float16} 8 

100 uint8 to float32 [rax] {uint8} 4 

101 sint8 to float32 [rax] {sint8} 4 

110 uint16 to float32 [rax] {uint16} 8 

111 sint16 to float32 [rax] {sint16} 8 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512 _mm512_extload_ps (void const*, MM_UPCONV_PS_ENUM, 
_MM_BROADCAST32_ENUM, int); 
—m512 _mm512_mask_extload_ps (_m512, __mmask16, void 


const*, MM_UPCONV_PS_ENUM, -MM_BROADCAST32_ENUM, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VBROADCASTF64X4 - Broadcast 4xFloat64 Vector 


Opcode Instruction Description 
MVEX.512.66.0F38.W1 1B vbroadcastf64x4 zmmi_ {k1}, Broadcast 4xfloat64 vector Uyg4(mz) into vec- 
/v Urealme) tor zmm1, under write-mask. 

Description 


The 32 bytes at memory address m; are broadcast to a float64 vector. The result is written 


into float64 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 


the corresponding bit clear in k1 retain their previous values. 


Operation 


// {4to8} 
tmpSrc2[255:0] = UpConvLoad fea (mz) 
for (n = 0; n < 8; n++) { 
if (kifn] != 0) f{ 
i = 64*n 
j = i & OxFF 
zmm1[i+63:i] = tmpSrc2[j+63:j]) 
} 
} 


Flags Affected 


None. 


Memory Up-conversion: U ;¢4 


525159 || Function: Usage disp8*N 
000 no conversion [rax] 32 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512d _mm512_extload_pd (void const*, MM_UPCONV_PD_ENUM, 
_MM_BROADCAST64_ENUM, int); 
_—m512d _mm512_mask_extload_pd (_m512, _mmasks, void const*, 


_MM_UPCONV_PD_ENUM, MM_BROADCAST64_ENUM, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VBROADCASTI32X4 - Broadcast 4xInt32 Vector 


Opcode Instruction Description 
MVEX.512.66.0F38.WO 5A _ vbroadcasti32x4 zmm1_ {k1}, Broadcast 4xint32 vector Uiz2(mz) into vector 
/v Ui3z2(m:) zmm1, under write-mask. 

Description 


The 4, 8 or 16 bytes (depending on the conversion and broadcast in effect) at memory 
address m; are broadcast and/or converted to a int32 vector. The result is written into 


int32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 


the corresponding bit clear in k1 retain their previous values. 


Operation 


// {4t016} 
tmpSrc2[127:0] = UpConvLoad;32 (mz) 
for (n = 0; n < 16; nt++) { 
if (kifm] != 0) { 
i 32*n 
j = i & OX7F 
zmmi[i+31:i] = 
} 
} 


i= 


tmpSrc2[j+31:j]) 


Flags Affected 


None. 


Memory Up-conversion: U;35 


525159 || Function: Usage disp8*N 
000 no conversion [rax] 16 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 4 

101 sint8 to sint32 [rax] {sint8} 4 

110 uint16 to uint32 [rax] {uint16} 8 

111 sint16 to sint32 [rax] {sint16} 8 


136 


Reference Number: 327364-001 


(intel 
CHAPTER 6. INSTRUCTION DESCRIPTIONS 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_extload_epi32 (void const*, MM_UPCONV_EPI32_ENUM, 
_MM_BROADCAST32_ENUM, int); 
_m512i _mm512_mask_extload_epi32 (_m512i, __mmask16, void const*, 


_MM_UPCONV_EPI32_ENUM, MM_BROADCAST32_ENUM, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VBROADCASTI64X4 - Broadcast 4xInt64 Vector 


Opcode Instruction Description 
MVEX.512.66.0F38.W1 5B vbroadcasti64x4 zmm1_ {k1}, Broadcast 4xint64 vector Uig4(mz) into vector 
/v Uiea(me) zmm1, under write-mask. 

Description 


The 32 bytes at memory address m; are broadcast to a int64 vector. The result is written 


into int64 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 


the corresponding bit clear in k1 retain their previous values. 


Operation 


// {4to8} 
tmpSrc2[255:0] = UpConvLoadje4 (mz) 
for (n = 0; n < 8; n++) { 
if (kifm] != 0) { 
i = 64*n 
j = i & OxFF 
zmm1[i+63:i] = tmpSrc2[j+63:j]) 
} 
} 


Flags Affected 


None. 


Memory Up-conversion: Uj¢4 


525159 || Function: Usage disp8*N 
000 no conversion [rax] 32 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_extload_epi64 (void const*, MM_UPCONV_EPI64_ENUM, 
_MM_BROADCAST64_ENUM, int); 
_m512i _mm512_mask_extload_epi64 (_m512i, —_mmaské8, void const*, 


_MM_UPCONV_EPI64_ENUM, MM_BROADCAST64_ENUM, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VBROADCASTSD - Broadcast Float64 Vector 


Opcode Instruction Description 
MVEX.512.66.0F38.W1 19  vbroadcastsd zmm1 {k1}, Broadcast float64 vector Ur¢4(m:) into vector 
/r Urealme) zmm1, under write-mask. 

Description 


The 8 bytes at memory address m, are broadcast to a float64 vector. The result is written 


into float64 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 


the corresponding bit clear in k1 retain their previous values. 


Operation 


// {1to08} 


tmpSrc2[63:0] = UpConvLoad fea (mez) 


for (n = 0; n < 8; nt++) { 


if (kifm] != 0) { 
i = 64*n 
zmm1[i+63:i] = tmpSrc2[63:0] 
} 
} 
Flags Affected 
None. 


Memory Up-conversion: U y¢4 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] 8 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512d _mm512_extload_pd (void const*, MM_UPCONV_PD_ENUM, 
_MM_BROADCAST64_ENUM, int); 
_—m512d _mm512_mask_extload_pd (_m512, _mmasks, void const*, 


_MM_UPCONV_PD_ENUM, MM_BROADCAST64_ENUM, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VBROADCASTSS - Broadcast Float32 Vector 


Opcode Instruction Description 
MVEX.512.66.0F38.W0O 18  vbroadcastss zmm1 {k1}, Broadcast float32 vector Ur32(m;,) into vector 
/r Uy32(me) zmm1, under write-mask. 

Description 


The 1, 2, or 4 bytes (depending on the conversion and broadcast in effect) at memory 
address m; are broadcast and/or converted to a float32 vector. The result is written into 


float32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 


the corresponding bit clear in k1 retain their previous values. 


Operation 


// {1t016} 
tmpSrc2[31:0] = UpConvLoad p32 (mz) 
for (n = 0; n < 16; n++) { 


if (kifm] != 0) { 
i = 32*n 
zmmi[i+31:i] = tmpSrc2[31:0] 
} 
} 
Flags Affected 
Invalid. 


Memory Up-conversion: U 3. 


S251So || Function: Usage disp8*N 
000 no conversion [rax] 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 float16 to float32 [rax] {float16} 2 

100 uint8 to float32 [rax] {uint8} 1 

101 sint8 to float32 [rax] {sint8} 1 

110 uint16 to float32 [rax] {uint16} 2 

111 sint16 to float32 [rax] {sint16} 2 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512 _mm512_extload_ps (void const*, MM_UPCONV_PS_ENUM, 
_MM_BROADCAST32_ENUM, int); 
_—m512 _mm512_mask_extload_ps (_m512, _mmask16, void const*, 


_MM_UPCONV_PS_ENUM, _MM_BROADCAST32_ENUM, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VCMPPD - Compare Float64 Vectors and Set Vector Mask 


Opcode Instruction 


MVEX.NDS.512.66.0RW1 C2 /rib vcmppd k2 {k1}, zmm1, S'¢4(zmm2/m;), imm8 


Description 
Compare between 
float64 vector zmm1 
and float64 vector 
Spoa(zmm2/m;) 
and store the re- 
sult in k2, under 
write-mask. 


Description 


Performs an element-by-element comparison between float64 vector zmm1 and the 
float64 vector result of the swizzle/broadcast/conversion from memory or float64 vector 
zmmz2. The result is written into vector mask k2. 


Note: If DAZ=1, denormals are treated as zeros in the comparison (original source regis- 
ters untouched). untouched). +0 equals —0. Comparison with NaN returns false. 


Infinity of like signs, are considered equals. Infinity values of either signs are considered 
ordered values. 


Table 6.3 summarizes VCMPPD behavior, in particular showing how various NaN results 
can be produced. 


Predicate | Imm8 enc | Description Emulation If NaN | QNaN operand signals invalid 
{eq} 000 A=B False No 
{It} 001 A<B False Yes 
{le} 010 A<=B False Yes 
{gt} A>B Swap operands, use LT False Yes 
{ge} A>=B Swap operands, use LE False Yes 
{unord} 011 Unordered True No 
{neq} 100 NOT(A = B) True No 
{nlt} 101 NOT(A < B) True Yes 
{nle} 110 NOT(A <= B) True Yes 
{ngt} NOT(A > B) Swap operands, use NLT | True Yes 
{nge} NOT(A >= B) | Swap operands, use NLE | True Yes 
{ord} 111 Ordered False No 
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Table 6.3: VCMPPD behavior 


The write-mask does not perform the normal write-masking function for this instruction. 
While it does enable/disable comparisons, it does not block updating of the destination; 
instead, if a write-mask bit is 0, the corresponding destination bit is set to 0. Nonethe- 
less, the operation is similar enough so that it makes sense to use the usual write-mask 
notation. This mode of operation is desirable because the result will be used directly as a 
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write-mask, rather than the normal case where the result is used with a separate write- 


mask that keeps the masked elements inactive. 


Immediate Format 


Comparison Type Ing IT, Ip 

eq Equal 0 oO O 
It Less than 0 oO 1 
le Less than or Equal 0 1 0 
unord | Unordered 0 1 1 
neq | Not Equal 1 O O 
nit Not Less than 1 Oo 1 
nle NotLessthanorEqual | 1 1 0 
ord Ordered 1 1 1 


Operation 


switch (IMM8[2:0] 
case 0: OP ¢ 
case 1: OP «+ 
case 2: OP ¢ 
case 3: OP ¢+ 
case 4: OP ¢ 
case 5: OP ¢+ 
case 6: OP ¢ 
case 7: OP ¢ 


} 


if(source is a register operand and MVEX.EH bit is 1) f{ 


){ 
EQ; break; 
LT; break; 
LE; break; 
UNORD; break; 
NEQ; break; 
NLT; break; 
NLE; break; 
ORD; break; 


if (SSS[2]==1) Supress_Exception_Flags() // SAE 


tmpSrc2[511:0] 


= zmm2[511:0] 


tmpSrc2[511:0] = SwizzUpConvLoad fe4 (zmm2/m;) 


{ 


} else { 
} 
for (n = 0; n < 8; nt++) { 
k2[n] = 0 
if(kifm] != 0) 
i = 64*n 


// float64 operation 


k2[n] = (zmm1[i+63:i] OP tmpSrc2[i+63:i]) 7 1: 


5 
} 


k2[15:8] = 0 
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Instruction Ps 


eudo-ops 


Compilers and assemblers may implement the following pseudo-ops in addition to the 


standard ins 


truction op: 


Pseudo-Op 


Implementation 


vempeqpd k2 {k1}, zmm1, Sg(zmm2/m;) 


vemppd k2 {k1}, zmm1, Sa(zmm2/mz,), {eq} 


vempltpd k2 {k1}, zmm1, Sg(zmm2/m,) 


vemppd k2 {k1}, zmm1, Sg(zmm2/m,), {It} 


vemplepd k2 {k1}, zmm1, Sg(zmm2/m;) 


vemppd k2 {k1}, zmm1, Sa(zmm2/mz,), {le} 


vempunordpd k2 {k1}, zmm1, Sg(zmm2/m,) 


vemppd k2 {k1}, zmm1, Sg(zmm2/m,), {unord} 


vempnegqpd k2 {k1}, zmm1, Sa(zmm2/m;) 


vemppd k2 {k1}, zmm1, Sa(zmm2/mz,), {neq} 


vempnitpd k2 {k1}, zmm1, Sg(zmm2/m,) 


vemppd k2 {k1},zmm1, Sg(zmm2/m,), {nlt} 


vempnlepd k2 {k1}, zmm1, Sg(zmm2/m:) 


vemppd k2 {k1}, zmm1, Sa(zmm2/m,), {nle} 


vempordpd k2 {k1}, zmm1, S,(zmm2/m;) 


vemppd k2 {k1}, zmm1, Sg(zmm2/m,), {ord} 


SIMD Floating 


-Point Exceptions 


Invalid, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
Not Applicable 


Memory Up-conversion: S 64 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Register Swizzle: S ¢¢4 
MVEX.EH=0 
S_5159 || Function: 4 x 64 bits Usage 
000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 
S2515o9 || Rounding Mode Override Usage 
1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—_mmask8 
—_mmask8 
—_mmask8 
—_mmask8 
—_mmask8 
—_mmask8 
—_mmask8 
—_mmask8 
—_mmask8 
—_mmask8 
—_mmask8 
—_mmask8 
—_mmask8 
—_mmask8 
—_mmask8 
—_mmask8 


Exceptions 


Real-Addres 


#UD 


_mm512_cmpeq_pd_mask (__m512d,__m512d); 


_mm512_mask_cmpeq_pd_mask(_mmask8 


Demis 


_mm51_cmplt_pd_mask(_m512d,__m512d); 


_mm512_mask_cmplt_pd_mask(_mmask8 


Pec 


_mm512_cmple_pd_mask(_m512d,_m512d); 


_mm512_mask_cmple_pd_mask(_mmask8,_m512d,_m512d); 


_mm512_cmpunord_pd_mask(_m512d,__m512d); 


_mm512_mask_cmpunord_pd_mask(_mmask8, __m512d,_m512d); 
_mm512_cmpneq_pd_mask(__m512d 
_mm512_mask_cmpneq_pd_mask(_mmask8,_m512d 
_mm512_cmpnlt_pd_mask(_m512d 
_mm512_mask_cmpnlt_pd_mask(_mmask8, _m512d,_m512d); 


, 


: 


m512d); 


Da 


m512d); 


_mm512_cmpnle_pd_mask(_m512d,_m512d); 


_mm512_mask_cmpnle_pd_mask(_mmask8, __m512d,__m512d); 


_mm512_cmpord_pd_mask(_m512d,__m512d); 


_mm512_mask_cmpord_pd_mask(_mmask8,__m512d,_m512d); 


s Mode and Virtual-8086 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 
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Instruction not available in these modes 


001 


m512d,__m512d); 


m512d,__m512d); 


m512d); 
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64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 


Reference Number: 327364-001 


(3 
=r 
2. 


CHAPTER 6. INSTRUCTION DESCRIPTIONS 


VCMPPS - Compare Float32 Vectors and Set Vector Mask 


Instruction 
vempps k2 {k1}, zmm1, S32(zmm2/m,), imm8 


Opcode 
MVEX.NDS.512.0F. WO C2 /r ib 


Description 

Compare between 
float32 vector zmm1 
and float32 ~—svvecctor 
Sp32(zmm2/m,) and 
store the result in k2, 
under write-mask. 


Description 


Performs an element-by-element comparison between float32 vector zmm1 and the 
float32 vector result of the swizzle/broadcast/conversion from memory or float32 vector 
zmmz2. The result is written into vector mask k2. 


Note: If DAZ=1, denormals are treated as zeros in the comparison (original source regis- 
ters untouched). untouched). +0 equals —0. Comparison with NaN returns false. 


Infinity of like signs, are considered equals. Infinity values of either signs are considered 
ordered values. 


Table 6.4 summarizes VCMPPS behavior, in particular showing how various NaN results 
can be produced. 


Predicate | Imm8 enc | Description Emulation If NaN | QNaN operand signals invalid 
{eq} 000 A=B False No 
{It} 001 A<B False Yes 
{le} 010 A<=B False Yes 
{gt} A>B Swap operands, use LT False Yes 
{ge} A>=B Swap operands, use LE False Yes 
{unord} 011 Unordered True No 
{neq} 100 NOT(A = B) True No 
{nt} 101 NOT(A < B) True Yes 
{nle} 110 NOT(A <= B) True Yes 
{ngt} NOT(A > B) Swap operands, use NLT | True Yes 
{nge} NOT(A >= B) | Swap operands, use NLE | True Yes 
{ord} 111 Ordered False No 


Table 6.4: VCMPPS behavior 


The write-mask does not perform the normal write-masking function for this instruction. 
While it does enable/disable comparisons, it does not block updating of the destination; 
instead, if a write-mask bit is 0, the corresponding destination bit is set to 0. Nonethe- 
less, the operation is similar enough so that it makes sense to use the usual write-mask 
notation. This mode of operation is desirable because the result will be used directly as a 
write-mask, rather than the normal case where the result is used with a separate write- 
mask that keeps the masked elements inactive. 
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Immediate Format 


Operation 


switch (IMM8[2: 
O: 


} 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 


I 


case 
case 
case 
case 
case 
case 
case 
case 


NO OP WNEF 


OP 
OP 
OP 
OP 
OP 
OP 
OP 
OP 


Comparison Type In I, Ip 

eq Equal 0 oO O 
It Less than 0 oO 1 
le Less than or Equal 0 1 0 
unord | Unordered 0 1 1 
neq | Not Equal 1 0 O 
nit Not Less than 1 Oo 1 
nle NotLessthanorEqual | 1 1 0 
ord Ordered 1 1 1 


0]) ¢f 

EQ; break; 
LT; break; 
LE; break; 
UNORD; break; 
NEQ; break; 
NLT; break; 
NLE; break; 
ORD; break; 


TT tv ee 


tmpSrc2[511:0] = zmm2[511:0] 
} else { 
tmpSrc2[511:0] = SwizzUpConvLoad p32 (zmm2/m;) 


for (n = 0; n < 16; n++) f{ 


} 


k2[n] = 0 


if (k1 [n] 
i = 32*n 
// float32 operation 


} 


k2[n] = (zmm1[i+31:i] OP tmpSrc2[it+31:i]) 7 1: 


= 0) { 


0 
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Instruction Pseudo-ops 


Compilers and assemblers may implement the following pseudo-ops in addition to the 


standard instruction op: 


Pseudo-Op 


Implementation 


vempeaps k2 {k1}, zmm1, S¢(zmm2/m,) 


vempps k2 {k1}, zmm1, S;(zmm2/mz,), {eq} 


vempltps k2 {k1}, zmm1, S;(zmm2/m;) 


vempps k2 {k1}, zmm1, S¢(zmm2/m,), {It} 


vempleps k2 {k1}, zmm1, S¢(zmm2/m,) 


vempps k2 {k1}, zmm1, S¢(zmm2/mz,), {le} 


vempunordps k2 {k1}, zmm1, S'¢(zmm2/m;) 


vempps k2 {k1}, zmm1, S+(zmm2/m,), {unord} 


vempnegps k2 {k1}, zmm1, S'¢(zmm2/m;) 


vempps k2 {k1}, zmm1, S+(zmm2/m,), {neq} 


vempnitps k2 {k1}, zmm1, S¢(zmm2/m,) 


vempps k2 {k1}, zmm1, S¢(zmm2/m,), {nlt} 


vempnleps k2 {k1}, zmm1, S'¢(zmm2/m;) 


vempps k2 {k1}, zmm1, S+(zmm2/m,), {nle} 


vempordps k2 {k1}, zmm1, S(zmm2/m) 


vempps k2 {k1}, zmm1, S¢(zmm2/m,), {ord} 


SIMD Floating-Point Exceptions 


Invalid, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
Not Applicable 


Memory Up-conversion: S;35 


525159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 
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Register Swizzle: S;3. 


MVEX.EH=0 

S255 || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

S2515o9 || Rounding Mode Override Usage 

1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_mmask16 _mm512_cmpeq_ps_mask (_m512,__m512); 


_mmask16 _mm512_mask_cmpeq_ps_mask (_mmask16,__m512,__m512); 
_mmask16 _mm51_cmplt_ps_mask (_m512,__m512); 
_—mmask16 _mm512_mask_cmplt_ps_mask (_mmask16,__m512,__m512); 


_mmask16 _mm512_cmple_ps_mask (_m512,__m512); 

_—mmask16 _mm512_mask_cmple_ps_mask (_mmask16,_m512,_m512); 
_—mmask16 _mm512_cmpunord_ps_mask (_m512,__m512); 

_mmask16 _mm512_mask_cmpunord_ps_mask (_.mmask16,_m512,__m512); 
_mmask16 _mm512_cmpneq_ps_mask (_m512,__m512); 

_mmask16 _mm512_mask_cmpneq_ps_mask (_mmask16,__m512,__m512); 
—mmask16 _mm512_cmpnlt_ps_mask (_m512,__m512); 

_mmask16 _mm512_mask_cmpnlt_ps_mask (_mmask16,_m512,__m512); 
_mmask16 _mm512_cmpnle_ps_mask (_m512,__m512); 

—mmask16 _mm512_mask_cmpnle_ps_mask (_mmask16,_m512,__m512); 
_—mmask16 _mm512_cmpord_ps_mask (_m512,__m512); 

—mmask16 _mm512_mask_cmpord_ps_mask (_mmask16,_m512,__m512); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 
#UD Instruction not available in these modes 
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64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VCVTDQ2PD - Convert Int32 Vector to Float64 Vector 


Opcode Instruction Description 

MVEX.512.F3.0FW0 E6 /r  vcvtdq2pd zmm1 {k1}, Sj32(zmm2/m;) Convert int32 vector 
Sizo(zmm2/m;,) to float64, and 
store the result in zmm1, under 
write-mask. 


Description 


Performs an element-by-element conversion from the int32 vector result of the swiz- 
zle/broadcast/conversion from memory or int32 vector zmm2 to a float64 vector . The 
result is written into float64 vector zmm1. The int32 source is read from either the lower 
half of the source operand (int32 vector zmm2), full memory source (8 elements, i.e. 256- 
bits) or the broadcast memory source. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc2[255:0] = zmm2[255:0] 

} else { 
tmpSrc2[255:0] = SwizzUpConvLoadj32 (zmm2/m;) 

} 


for (n = 0; n < 8; nt+) { 
if(kilm] != 0) { 
i = 64*n 
j = 32*n 
zmmi[it+63:i] = 
CvtInt32ToFloat64(tmpSrc2[j+31:j]) 


SIMD Floating-Point Exceptions 


None. 
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Treat Input Denormals As Zeros : 
Not Applicable 


Flush Tiny Results To Zero : 
Not Applicable 


Memory Up-conversion: S;35 


S251Spo || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 32 

001 broadcast 1 element (x8) [rax] {1to8} 4 

010 broadcast 4 elements (x4) | [rax] {4to8} 16 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_m512d 
_m512d 
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_mm512_cvtepi32lo_pd (_m512i); 
_mm512_mask_cvtepi32lo_pd (_m512d,__mmask8, _m512i); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to 4, 16 or 32-byte (depending on the swizzle broadcast). 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
This instruction does not support any 
SwizzUpConv involving data conversion. 
If SwizzUpConvMem function from memory is set to any 
value different than "no action", {1t08} or{4to8} 
then an Invalid Opcode fault is raised. Note 
that this rule only applies to memory conversions 
(register swizzles are allowed). 
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VCVTFXPNTDQ2PS - Convert Fixed Point Int32 Vector to Float32 Vector 


Opcode 


MVEX.512.0F3A.W0 CB /r ib 


Instruction 


vevtfxpntdq2ps zmm1 {k1}, S;32(zmm2/m,), imms 


Description 

Convert int32 vector 
Sj32(zmm2/m:z) to 
float32, and store 
the result in zmm1, 
using imm8, under 
write-mask. 


Description 


Performs an element-by-element conversion from the int32 vector result of the swiz- 
zle/broadcast/conversion from memory or int32 vector zmm2 to a float32 vector , then 
performs an optional adjustment to the exponent. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Immediate Format 


Exponent Adjustment | value Iz Ig Is I 
0 2° (32.0-no exponentadjustment) | 0 0 0 0 
4 27 (28.4) 0 0 O0O 1 
5 o7 (975) 0 0 1 =O 
8 2° (24.8) 0° 0 4 4 
16 2'© (16.16) 0 1 0 0 
24 24 (8.24) 0 1 0 1 
31 Pam Ce 0 1 1 #0 
32 28 (0.32) 0 1 1 1 
reserved *must UD* 1 x x x 
Operation 
expadj = IMM8[6:4] 


if(source is a register operand and MVEX.EH bit is 1) f{ 

if (SSS[2]==1) Supress_Exception_Flags() // SAE 

// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 

tmpSrc2[511:0] = zmm2[511:0] 


} else { 
RoundingMode 
tmpSrc2[511:0 
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for (n = 0; n < 16; n++) { 


if (k1 [n] 


= 0) { 


i = 32*n 
zmm1[i+31:i] = 
CvtInt32ToFloat32(tmpSrc2[i+31:i], RoundingMode) / EXPADJ_TABLE[expadj] 


} 
} 


SIMD Floating-Point Exceptions 


Precision. 


Denormal Handling 


Treat Input Denormals As Zeros : 
Not Applicable 


Flush Tiny Results To Zero : 
Not Applicable 


Memory Up-conversion: S;35 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 
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Register Swizzle: S;3. 


MVEX.EH=0 

S2S1So || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_cvtfxpnt_round_adjustepi32_ps(_m512i, int, MM_EXP_ADJ_ENUM); 
—m512 _mm512_mask_cvtfxpnt_round_adjustepi32_ps( _m512, _mmask16, _m512i, 
int, MM_EXP_ADJ_ ENUM); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If amemory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
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If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VCVTFXPNTPD2DQ - Convert Float64 Vector to Fixed Point Int32 Vector 


Opcode 
MVEX.512.F2.0F3A.W1 E6 /r ib 


Instruction 


vevtfxpntpd2dq zmm1 {k1}, S¢e4(zmm2/mz), 7mms 


Description 
Convert 

float64 vector 
Spoa(zmm2/mz) 
to int32, and 
store the result 
in zmm1,_ using 


mms, under 
write-mask. 
Description 
Performs an element-by-element conversion and rounding from the float64 vector result 
of the swizzle/broadcast/conversion from memory or float64 vector zmm2 to a int32 vec- 
tor. The int32 result is written into the lower half of the destination register zmm1; the 
other half of the destination is set to zero. 
Out-of-range values are converted to the nearest representable value and that NaNs con- 
vert to 0, because this makes the calculation of Exp2 more efficient (avoiding problems 
with converting very large values to integers, where undetected incorrect values could 
otherwise result from overflow). Table 6.5 describes what should be the result when deal- 
ing with floating-point special number. 
Input | Result 
NaN | 0 
+oo | INT_MAX 
+0 0 
-0 0 
—coo | INT_MIN 
Table 6.5: Converting to integer special floating-point values behavior 
This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 
Immediate Format 
Rounding Mode I, Ib 
rn | Round to Nearest (even) 0 O 
rd | Round Down (Round toward Negative Infinity) | 0 1 
ru | Round Up (Round toward Positive Infinity) 1 O 
rz | Round toward Zero 1 1 
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Operation 


RoundingMode = IMM8[1:0] 


if(source is a register operand and MVEX.EH bit is 1) { 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpSrc2[511:0] = zmm2[511:0] 

} else { 
tmpSrc2[511:0] = SwizzUpConvLoad fe4 (zmm2/m;) 

} 


for (n = 0; n < 8; nt++) f{ 
if(kifm] != 0) f 
i = 64*n 
j = 32*n 
zmmi1[j+31:j] = 
CvtFloat64ToInt32(tmpSrc2[i+63:i], RoundingMode) 
} 
} 


zmm1[511:256] = 0 


SIMD Floating-Point Exceptions 


Invalid, Precision. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
Not Applicable 


Memory Up-conversion: S ;¢4 


525159 || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Register Swizzle: S ¢¢4 


MVEX.EH=0 

S2S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_cvtfxpnt_roundpd_epi32lo(_m512d, int); 
—m512i _mm512_mask_cvtfxpnt_roundpd_epi32lo(_m512i,__mmask8, _m5122d, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VCVTFXPNTPD2UDQ - Convert Float64 Vector to Fixed Point Uint32 Vec- 
tor 


Opcode Instruction Description 

MVEX.512.F2.0F3A.W1 CA /rib  vcvtfxpntpd2udq zmm1 {k1}, Srg4(zmm2/m;),imm8& Convert 
float64 vector 
Spoa(zmm2/mz) 
to uint32, and 
store the result 
in zmm1, using 
mms, under 
write-mask. 


Description 


Performs an element-by-element conversion and rounding from the float64 vector result 
of the swizzle/broadcast/conversion from memory or float64 vector zmm2 to a uint32 
vector. The uint32 result is written into the lower half of the destination register zmm1; 
the other half of the destination is set to zero. 


Out-of-range values are converted to the nearest representable value and that NaNs con- 
vert to 0, because this makes the calculation of Exp2 more efficient (avoiding problems 
with converting very large values to integers, where undetected incorrect values could 
otherwise result from overflow). Table 6.6 describes what should be the result when deal- 
ing with floating-point special number. 


Input | Result 


NaN | 0 
+00 INT_MAX 
+0 0 
-0 0 


—oo INT_MIN 


Table 6.6: Converting to integer special floating-point values behavior 
This instruction is write-masked, so only those elements with the corresponding bit set 


in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Immediate Format 


— 
ran 


Rounding Mode 

rn | Round to Nearest (even) 

rd | Round Down (Round toward Negative Infinity) 
ru | Round Up (Round toward Positive Infinity) 

rz | Round toward Zero 


Rl PR} olo 
Rm] OolR| ol 
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Operation 


RoundingMode = IMM8[1:0] 


if(source is a register operand and MVEX.EH bit is 1) { 


if (SSS[2]==1) Supress_Exception_Flags() // SAE 


tmpSrc2[511:0] = zmm2[511:0] 
} else { 


tmpSrc2[511:0] = SwizzUpConvLoad fe4 (zmm2/m;) 


} 


for (n = 0; n < 8; nt++) f{ 
if(ki[n] != 0) f{ 
i = 64*n 
j = 32*n 
zmmi1[j+31:j] = 


CvtFloat64ToUint32 (tmpSrc2[i+63:i], RoundingMode) 


} 
} 


zmm1[511:256] = 0 


SIMD Floating-Point Exceptions 


Invalid, Precision. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
Not Applicable 


Memory Up-conversion: S ;¢4 


Usage 


disp8*N 


S2S1Spo || Function: 

000 no conversion 

001 broadcast 1 element (x8) 
010 broadcast 4 elements (x2) 
011 reserved 

100 reserved 

101 reserved 

110 reserved 

111 reserved 


[rax] {8to8} or [rax] 
[rax] {1to8} 

[rax] {4to8} 

N/A 

N/A 

N/A 

N/A 

N/A 


64 
8 

32 
N/A 
N/A 
N/A 
N/A 
N/A 
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Register Swizzle: S ¢¢4 


MVEX.EH=0 

S2S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_cvtfxpnt_roundpd_epi32lo(_m512d, int); 
—m512i _mm512_mask_cvtfxpnt_roundpd_epi32lo(_m512i,__mmask8, _m5122d, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VCVTFXPNTPS2DQ - Convert Float32 Vector to Fixed Point Int32 Vector 


Opcode Instruction Description 

MVEX.512.66.0F3A.W0 CB /rib  vcvtfxpntps2dq zmm1 {k1}, S32(zmm2/m;),imm8 Convert 
float32 vector 
Sp32(zmm2/mz) 
to int32, and 
store the result 
in zmm1, using 
imms, under 
write-mask. 


Description 


Performs an element-by-element conversion and rounding from the float32 vector result 
of the swizzle/broadcast/conversion from memory or float32 vector zmm2 to a int32 vec- 
tor , with an optional exponent adjustment before the conversion. 


Out-of-range values are converted to the nearest representable value and that NaNs con- 
vert to 0, because this makes the calculation of Exp2 more efficient (avoiding problems 
with converting very large values to integers, where undetected incorrect values could 
otherwise result from overflow). Table 6.7 describes what should be the result when deal- 
ing with floating-point special number. 


Input | Result 


NaN | 0 
+00 INT_MAX 
+0 0 
-0 0 


—oo INT_MIN 


Table 6.7: Converting to integer special floating-point values behavior 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Immediate Format 


— 
ran 


Rounding Mode 

rn | Round to Nearest (even) 

rd | Round Down (Round toward Negative Infinity) 
ru | Round Up (Round toward Positive Infinity) 

rz | Round toward Zero 


Rl PR} olo 
RB] Ol R| ol 
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Exponent Adjustment | value Iz Ig Is I 
0 2° (32.0- no exponent adjustment) | 0 0 0 0 
4 27 (28.4) 0 0 0 1 
5 9° (27.5) 0 0 1 =O 
8 25 (24.8) 0 0 1 4 
16 27 (16.16) oO £' 2) oO 
24 274 (8.24) 0 1 0 1 
31 or 131) 0 1 1 =O 
32 9° (0.32) a a res | 
reserved *must UD* 1 x x x 
Operation 


RoundingMode = IMM8[1:0] 
expadj = IMM8[6:4] 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpSrc2[511:0] = zmm2[511:0] 

} else { 
tmpSrc2[511:0] = SwizzUpConvLoad 32 (zmm2/m,) 

+: 


for (n = 0; n < 16; n++) f{ 
if (ki [al t= 0) f 
i = 32*n 
zmm1[i+31:i] = 
CvtFloat32ToInt32(tmpSrc2[i+31:i] * EXPADJ_TABLE[expadj] , RoundingMode) 


SIMD Floating-Point Exceptions 


Invalid, Precision. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
Not Applicable 
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Memory Up-conversion: S;35 

S2515o || Function: Usage disp8*N 

000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 


Register Swizzle: S35 


MVEX.EH=0 
S55S1Spo || Function: 4 x 32 bits Usage 
000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 
525159 || Rounding Mode Override Usage 
1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i 
—m512i 


_mm512_cvtfxpnt_round_adjustps_epi32(__m512, int, MM_EXP_ADJ_ENUM); 


int, MM_EXP_ADJ_ENUM); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 
#UD Instruction not available in these modes 
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64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VCVTFXPNTPS2UDQ - Convert Float32 Vector to Fixed Point Uint32 Vec- 


tor 


Opcode 


MVEX.512.66.0F3A.W0 CA /r ib 


Instruction 


vevtfxpntps2udq zmm1 {k1}, S32(zmm2/m;), imms 


Description 
Convert 

float32 vector 
Sf32(zmm2/m:) 
to uint32, and 
store the result 
in zmm1, using 
imms, under 
write-mask. 


Description 


Performs an element-by-element conversion and rounding from the float32 vector result 
of the swizzle/broadcast/conversion from memory or float32 vector zmm2 to a uint32 
vector , with an optional exponent adjustment before the conversion. 


Out-of-range values are converted to the nearest representable value and that NaNs con- 
vert to 0, because this makes the calculation of Exp2 more efficient (avoiding problems 
with converting very large values to integers, where undetected incorrect values could 
otherwise result from overflow). Table 6.8 describes what should be the result when deal- 
ing with floating-point special number. 


Table 6.8: Converting to integer special floating-point values behavior 


Input | Result 

NaN | 0 

t+oo | INT_MAX 
+0 0 

-0 0 

—coo | INT_MIN 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 


the corresponding bit clear in k1 retain their previous values. 


Immediate Format 


Rounding Mode I, Ip 
rn | Round to Nearest (even) 0 O 
rd | Round Down (Round toward Negative Infinity) | 0 1 
ru | Round Up (Round toward Positive Infinity) 1 O 
rz | Round toward Zero 1 1 
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Exponent Adjustment | value Iz Ig Is I 
0 2° (32.0- no exponent adjustment) | 0 0 0 0 
4 27 (28.4) 0 0 0 1 
5 9° (27.5) 0 0 1 =O 
8 25 (24.8) 0 0 1 4 
16 27 (16.16) oO £' 2) oO 
24 274 (8.24) 0 1 0 1 
31 or 131) 0 1 1 =O 
32 9° (0.32) a a res | 
reserved *must UD* 1 x x x 
Operation 


RoundingMode = IMM8[1:0] 
expadj = IMM8[6:4] 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpSrc2[511:0] = zmm2[511:0] 

} else { 
tmpSrc2[511:0] = SwizzUpConvLoad 32 (zmm2/m,) 

+: 


for (n = 0; n < 16; n++) f{ 
i£(ki [ol t= 0) 
i = 32*n 
zmm1[i+31:i] = 
CvtFloat32ToUint32 (tmpSrc2[i+31:i] * EXPADJ_TABLE[expadj] , RoundingMode) 


SIMD Floating-Point Exceptions 


Invalid, Precision. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
Not Applicable 
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Memory Up-conversion: S;35 

S2515o || Function: Usage disp8*N 

000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 


Register Swizzle: S35 


MVEX.EH=0 
S55S1Spo || Function: 4 x 32 bits Usage 
000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 
525159 || Rounding Mode Override Usage 
1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i 
—m512i 


_mm512_cvtfxpnt_round_adjustps_epi32(__m512, int, MM_EXP_ADJ_ENUM); 


int, MM_EXP_ADJ_ENUM); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 
#UD Instruction not available in these modes 
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64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VCVTFXPNTUDQZ2PS - Convert Fixed Point Uint32 Vector to Float32 Vec- 
tor 


Opcode Instruction Description 

MVEX.512.0F3A.W0 CA /rib  vevtfxpntudq2ps zmm1 {k1}, Sj32(zmm2/m,),imm8 Convert uint32 vec- 
tor Si32(zmm2/mz) 
to float32, and store 
the result in zmm1, 
using imm8, under 
write-mask. 


Description 


Performs an element-by-element conversion from the uint32 vector result of the swiz- 
zle/broadcast/conversion from memory or uint32 vector zmm2 to a float32 vector, then 
performs an optional adjustment to the exponent. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Immediate Format 


Exponent Adjustment | value Iz Ig Is I 
0 2° (32.0-no exponentadjustment) | 0 0 0 0 
4 24 (28.4) 0 0 O0O 1 
c OF (97.5) 0 0 1 =O 
8 28 (24.8) 0 0 1 1 
16 27° (16.16) 0 1 0 O 
24 24 (8.24) 0 1 0 1 
31 28 (Si) 0 1 1 =O 
32 2°" (0:32) Oo 1 1 1 
reserved *must UD* 1 x x x 
Operation 


expadj = IMM8[6:4] 
if(source is a register operand and MVEX.EH bit is 1) f{ 

if (SSS[2]==1) Supress_Exception_Flags() // SAE 

// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 

RoundingMode = SSS[1:0] 

tmpSrc2[511:0] = zmm2[511:0] 
} else f{ 

RoundingMode = MXCSR.RC 
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tmpSrc2[511:0] = SwizzUpConvLoadj32 (zmm2/m;,) 


} 
for (n = 0; n < 16; n++) f{ 
if(ki[n] != 0) f{ 
i = 32*n 


zmm1[i+31:i] = 
CvtUint32ToFloat32(tmpSrc2[i+31:i] , RoundingMode) / EXPADJ_TABLE[expadj] 


- 
} 


SIMD Floating-Point Exceptions 


Precision. 


Denormal Handling 


Treat Input Denormals As Zeros : 
Not Applicable 


Flush Tiny Results To Zero : 
Not Applicable 


Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 
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Register Swizzle: S;3. 


MVEX.EH=0 

S255 || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VCVTPD2PS - Convert Float64 Vector to Float32 Vector 
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Opcode Instruction Description 
MVEX.512.66.0RW15A/r  vcvtpd2ps zmm1 {k1}, Sye4(zmm2/m,) Convert float64 vector 
Syea(zmm2/m;,) to float32, and 
store the result in zmmi1, under 
write-mask. 
Description 


Performs an element-by-element conversion and rounding from the float64 vector result 
of the swizzle/broadcast/conversion from memory or float64 vector zmm2 to a float32 
vector . The result is written into float32 vector zmm1. The float32 result is written into 
the lower half of the destination register zmm1; the other half of the destination is set to 


Zero. 


Input | Result 

NaN | Quietized NaN. Copy leading bits of float64 significand 
+00 +00 

+0 +0 

-0 —0 

—oo —oo 


Table 6.9: Converting float64 to float32 special values behavior 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc2[511:0] = zmm2[511:0] 


} else { 
RoundingMode 
tmpSrc2[511:0 

} 


] 


MXCSR.RC 
= SwizzUpConvLoad r¢g4 (zmm2/m;) 


for (n = 0; n < 8; nt+) { 
if(ki[n] != 0) { 


i = 64*n 
j = 32+*n 


zmm1[j+31:j] = 
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} 
i 


zmm1[511:256] = 0 


SIMD Floating-Point Exceptions 


CvtFloat64ToFloat32(tmpSrc2[it+63:i], RoundingMode) 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 


(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S 64 


$2519 || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Register Swizzle: S ¢¢4 


MVEX.EH=0 

S255 || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512 _mm512_cvtpd_pslo (_m512d); 


—m512 _mm512_mask_cvtpd_pslo (_m512d,__mmask8, _m512d); 


— 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
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#PF(fault-code) 
#NM 
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If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VCVTPS2PD - Convert Float32 Vector to Float64 Vector 


Opcode Instruction Description 

MVEX.512.0FW0 5A /r_ vcvtps2pd zmm1 {k1}, Sy32(zmm2/m,) Convert float32 vector 
S32(zmm2/m,) to float64, and store 
the result in zmm1, under write-mask. 


Description 


Performs an element-by-element conversion and rounding from the float32 vector result 
of the swizzle/broadcast/conversion from memory or float32 vector zmm2 to a float64 
vector . The result is written into float64 vector zmm1. The float32 source is read from 
either the lower half of the source operand (float32 vector zmm2), full memory source (8 
elements, i.e. 256-bits) or the broadcast memory source. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpSrc2[255:0] = zmm2[255:0] 

} else { 
tmpSrc2[255:0] = SwizzUpConvLoad p32 (zmm2/m,) 

} 


for (n = 0; n < 8; nt++) f{ 
if(ki[m] != 0) { 
i = 64*n 
j = 32*n 
zmmi[i+63:i] = 
CvtFloat32ToFloat64 (tmpSrce2[j+31:j]) 


SIMD Floating-Point Exceptions 


Invalid, Denormal. 
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Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny 
Not 


Results To Zero: 
Applicable 


Memory Up-conversion: S;35 


S2515o || Function: Usage disp8*N 

000 no conversion [rax] {8to8} or [rax] 32 

001 broadcast 1 element (x8) [rax] {1to8} 4 

010 broadcast 4 elements (x4) | [rax] {4to8} 16 

011 reserved N/A N/A 

100 reserved N/A N/A 

101 reserved N/A N/A 

110 reserved N/A N/A 

111 reserved N/A N/A 
Register Swizzle: Ss» 

MVEX.EH=0 

S555 || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 

001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 

MVEX.EH=1 

525159 || Rounding Mode Override Usage 

1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_m512d 
_m512d 


_mm512_cvtpslo_pd (__m512); 


_mm512_mask_cvtpslo_pd (_m512d, _ 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to 4, 16 or 32-byte (depending on the swizzle broadcast). 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
This instruction does not support any 
SwizzUpConv involving data conversion. 
If SwizzUpConvMem function from memory is set to any 
value different than "no action", {1t08} or{4to8} 
then an Invalid Opcode fault is raised. Note 
that this rule only applies to memory conversions 
(register swizzles are allowed). 
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VCVTUDQ2PD - Convert Uint32 Vector to Float64 Vector 


Opcode Instruction Description 
MVEX.512.F3.0R WO 7A /r  vevtudq2pd zmm1 {k1}, Siz0(zmm2/m,) Convert uint32 


write-mask. 


vector 


Si32(zmm2/m,) to float64, and 
store the result in zmm1, under 


Description 


Performs an element-by-element conversion from the uint32 vector result of the swiz- 
zle/broadcast/conversion from memory or uint32 vector zmm2 to a float64 vector . The 
result is written into float64 vector zmm1. The uint32 source is read from either the lower 
half of the source operand (uint32 vector zmm2), full memory source (8 elements, i.e. 
256-bits) or the broadcast memory source. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc2[255:0] = zmm2[255:0] 

} else { 
tmpSrc2[255:0] = SwizzUpConvLoadj32 (zmm2/m;) 

} 


for (n = 0; n < 8; nt+) { 
if(kilm] != 0) { 
i = 64*n 
j = 32*n 
zmmi[it+63:i] = 
CvtUint32ToFloat64(tmpSrc2[j+31:j]) 


SIMD Floating-Point Exceptions 


None. 
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Denormal Handling 


Treat Input Denormals As Zeros : 
Not Applicable 


Flush Tiny Results To Zero : 
Not Applicable 


Memory Up-conversion: S;35 


S251Spo || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 32 

001 broadcast 1 element (x8) [rax] {1to8} 4 

010 broadcast 4 elements (x4) | [rax] {4to8} 16 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_m512d 
_m512d 
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_mm512_cvtepu32lo_pd (_m512i); 
_mm512_mask_cvtepu32lo_pd (_m512d,__mmask8,___m512i); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 


to 4, 16 or 32-byte (depending on the swizzle broadcast). 


For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 

This instruction does not support any 

SwizzUpConv involving data conversion. 

If SwizzUpConvMem function from memory is set to any 
value different than "no action", {1t08} or{4to8} 

then an Invalid Opcode fault is raised. Note 

that this rule only applies to memory conversions 
(register swizzles are allowed). 


189 


(intel 
CHAPTER 6. INSTRUCTION DESCRIPTIONS 


VEXP223PS - Base-2 Exponential Calculation of Float32 Vector 


Opcode Instruction Description 
MVEX.512.66.0F38.W0O C8 vexp223ps zmm1 {k1},zmm2/m, Calculate the approx. exp2 from int32 vector 
/v zmm2/m, and store the result in zmm1, under 
write-mask. 
Description 


Computes the element-by-element base-2 exponential computation of the int32 vector 
on memory or int32 vector zmm2 with 0.99ULP (relative error). Input int32 values are 
considered as fixed point numbers with a fraction offset of 24 bits (i.e. 8 MSBs correspond 
to sign and integer part; 24 LSBs correspond to fractional part). The result is written into 
float32 vector zmm1. 


exp2 of a FP input value is computed as a two-instruction sequence: 


1. vevtfxpntps2dq (with exponent adjustment, so that destination format is 32b, with 
8b for integer part and 24b for fractional part) 


2. vexp223ps 


All overflows are captured by the combination of the saturating behavior of vcvtfxp- 
ntps2dq instruction and the detection of MAX_INT/MIN_INT by the vexp223ps instruc- 
tion. Tiny input numbers are quietly flushed to the fixed-point value 0 by the vcvtfxp- 
ntps2dq instruction, which produces an overall output exp2(0) = 1.0f. 


The overall behavior of the two-instruction sequence is the following: 


¢ —oo returns +0.0f 

e +0.0f returns 1.0f (exact result) 

e +oo returns +00 (#Overflow) 

NaN returns 1.0f (#Invalid) 

n, where n is an integral value returns 2” (exact result) 


Input Result | Comments 
MIN_INT | +0.0f 
MAX_INT | +00 Raise #0 flag 


Table 6.10: vexp2_1ulp() special int values behavior 
This instruction is write-masked, so only those elements with the corresponding bit set 


in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 
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Operation 


tmpSrc2[511:0] = zmm2/m, 


if(source is a register operand and MVEX.EH bit is 1) { 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
} 
for (n = 0; n < 16; n++) { 
if (kifm] != 0) f 
i = 32*n 
zmm1[i+31:i] = exp2_1ulp(tmpSrc2[i+31:i]) 
} 
} 


SIMD Floating-Point Exceptions 


Overflow. 


Denormal Handling 


Treat Input Denormals As Zeros : 
Not Applicable 


Flush Tiny Results To Zero : 
YES 


Register Swizzle 


MVEX.EH=0 
S5S1Spo || Function: 4 x 32 bits Usage 
000 no swizzle zmm0 or zmm0 {dcba} 
001 reserved N/A 
010 reserved N/A 
011 reserved N/A 
100 reserved N/A 
101 reserved N/A 
110 reserved N/A 
111 reserved N/A 
MVEX.EH=1 
S$25Sq || Rounding Mode Override Usage 
1xx SAE (Supress-All-Exceptions) , {sae} 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_exp223_ps (_m512i); 
—m512 _mm512_mask_exp223_ps (_m512,_mmask16, _m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 

This instruction does not support any 

SwizzUpConv different from the default value (no broadcast, 
no conversion). If SwizzUpConv function is set to any value 
different than "no action", then an Invalid Opcode fault is 
raised. This includes register swizzles. 
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VFIXUPNANPD - Fix Up Special Float64 Vector Numbers With NaN Passthrough 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.W1 55 /r_ vfixupnanpd zmm1 {k1}, zmm2, Sjg4(zmm3/m:) Fix up, with NaN 
passthrough, spe- 
cial numbers in 
float64 vector 
zmm1, float64 
vector zmm2 
and int64 vector 
Siea4(zmm3/m:z) 
and store the result 
in zmmi, under 
write-mask. 


Description 


Performs an element-by-element fix-up of various real and special number types in 
the float64 vector zmm2 using the 21-bit table values from the result of the swiz- 
zle/broadcast/conversion process on memory or int64 vector zmm3. The result is 
merged into float64 vector zmm1. Unlike in vfixuppd, source NaN values are passed- 
through as quietized values. Note that, also unlike in vfixup, this quietization translates 
into a #IE exception flag being reported for input SNaNs. 


This instruction is specifically intended for use in fixing up the results of arithmetic cal- 
culations involving one source, although it is generally useful for fixing up the results of 
multiple-instruction sequences to reflect special-number inputs. For example, consider 
rcp(0). Input 0 to rcp, and you should get inf. However, evaluating rcp via 2x — ax? 
(Newton-Raphson), where « = approx(1/0) = ov, incorrectly yields NaN. To deal with 
this, vfixupps can be used after the N-R reciprocal sequence to set the result to oo when 
the input is 0. 


Denormal inputs must be treated as zeros of the same sign if DAZ is enabled. 


Note that NO_CHANGE_TOKEN leaves the destination (output) unchanged. This means 
that if the destination is a denormal, its value is not flushed to 0. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


enum TOKEN_TYPE 
{ 
NO_CHANGE_TOKEN = 0, 
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NEG_INF_TOKEN 
NEG_ZERO_TOKEN 
POS_ZERO_TOKEN 
POS_INF_TOKEN 
NAN_TOKEN 
MAX_DOUBLE_TOKEN 
MIN_DOUBLE_TOKEN 


i] 
NO OPWNEF 


} 


if(source is a register operand and MVEX.EH bit is 1) { 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpzmm3[511:0] = zmm3[511:0] 

} else { 
tmpzmm3[511:0] = SwizzUpConvLoadjg4(zmm3/m;) 

} 


for (n = 0; n < 8; nt++) f{ 
if (kifm] != 0) f 
i = 64*n 
tsrc[63:0] = zmm2[i+63:i] 


if (IsNaN(tsrc [63:0] ) 


{ 
zmmi[it63:i] = QNaN(zmm2[i+63:i]) 

} 

else 

af 
// tmp is an int value 
if (tsrc[63:0] == -inf) tmp = 0 
else if (tsrc[63:0] < 0) tmp = 1 
else if (tsrc[63:0] == -0) tmp = 2 
else if (tsrc[63:0] == +0) tmp = 3 
else if (tsrc[63:0] == inf) tmp = 5 
else /* tsrc[63:0] > 0 */ tmp = 4 


table[20:0] = tmpzmm3[i+63:i] 

token = table[(tmp*3)+2: tmp*3] // table is viewed as one 21-bit 
// little-endian value. 
// token is an int value 
// the 7th entry is unused 


// float64 result 
if (token == NEG_INF_TOKEN) zmmi[i+63:i] = -inf 
else if (token == NEG_ZERO_TOKEN) zmm1[i+63:i] = -0O 
else if (token == POS_ZERO_TOKEN) zmm1[i+63:i] = +0 
else if (token == POS_INF_TOKEN) zmmi[i+63:i] = +inf 
else if (token == NAN_TOKEN) zmm1[i+63:i] = QNaN_indefinite 
else if (token == MAX _DOUBLE_TOKEN) zmmi[i+63:i] = NMAX 
else if (token == MIN_DOUBLE_TOKEN) zmm1[i+63:i] = -NMAX 
else if (token == NO_CHANGE_TOKEN) { /* zmm1i[i+63:i] remains unchanged */ } 
} 
} 
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SIMD Floating-Point Exceptions 


Invalid. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 


NO 


Memory Up-conversion: S;¢4 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Register Swizzle: Sie4 


MVEX.EH=0 

S5S1Spo || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

5251509 || Rounding Mode Override Usage 

1xx SAE (Supress-All-Exceptions) , {sae} 


Reference Number: 327364-001 


195 


CHAPTER 6. INSTRUCTION DESCRIPTIONS 


> 
D 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512d _mm512_fixupnan_pd (_m512d,__m512d,__m512i); 
_—m512d _mm512_mask_fixupnan_pd (_m512d,_mmask8,__m512d,_m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFIXUPNANPS - Fix Up Special Float32 Vector Numbers With NaN Passthrough 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.W0 55 /r_-vfixupnanps zmm1 {k1}, zmm2, S;32(zmm3/m;) Fix up, with NaN 
passthrough, spe- 
cial numbers in 
float32 vector 
zmm1, float32 
vector zmm2 
and int32 vector 
Si32(zmm3/m+) 
and store the result 
in zmmi, under 
write-mask. 


Description 


Performs an element-by-element fix-up of various real and special number types in 
the float32 vector zmm2 using the 21-bit table values from the result of the swiz- 
zle/broadcast/conversion process on memory or int32 vector zmm3. The result is 
merged into float32 vector zmm1. Unlike in vfixupps, source NaN values are passed- 
through as quietized values. Note that, also unlike in vfixup, this quietization translates 
into a #IE exception flag being reported for input SNaNs. 


This instruction is specifically intended for use in fixing up the results of arithmetic cal- 
culations involving one source, although it is generally useful for fixing up the results of 
multiple-instruction sequences to reflect special-number inputs. For example, consider 
rcp(0). Input 0 to rcp, and you should get inf. However, evaluating rcp via 2x — ax? 
(Newton-Raphson), where « = approx(1/0) = ov, incorrectly yields NaN. To deal with 
this, vfixupps can be used after the N-R reciprocal sequence to set the result to oo when 
the input is 0. 


Denormal inputs must be treated as zeros of the same sign if DAZ is enabled. 


Note that NO_CHANGE_TOKEN leaves the destination (output) unchanged. This means 
that if the destination is a denormal, its value is not flushed to 0. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


enum TOKEN_TYPE 
{ 
NO_CHANGE_TOKEN = 0, 
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NEG_INF_TOKEN 
NEG_ZERO_TOKEN 
POS_ZERO_TOKEN 
POS_INF_TOKEN 
NAN_TOKEN 
MAX_FLOAT_TOKEN 
MIN_FLOAT_TOKEN 


iow uot 
NO OPWNEFE 


} 


if(source is a register operand and MVEX.EH bit is 1) { 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpzmm3[511:0] = zmm3[511:0] 

} else { 
tmpzmm3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
if (kifm] != 0) f 
i = 32*n 
tsrc[31:0] = zmm2[i+31:i] 


if (IsNaN(tsrc[31:0]) 


{ 
zmmi[it31:i] = QNaN(zmm2[i+31:i]) 

} 

else 

af 
// tmp is an int value 
if (tsrc[31:0] == -inf) tmp = 0 
else if (tsrc[31:0] < 0) tmp = 1 
else if (tsrc[31:0] == -0) tmp = 2 
else if (tsrc[31:0] == +0) tmp = 3 
else if (tsrc[31:0] == inf) tmp = 5 
else /* tsrc[31:0] > 0 */ tmp = 4 


table[20:0] = tmpzmm3[i+31:i] 

token = table[(tmp*3)+2: tmp*3] // table is viewed as one 21-bit 
// little-endian value. 
// token is an int value 
// the 7th entry is unused 


// float32 result 
if (token == NEG_INF_TOKEN) zmmi[i+31:i] = -inf 
else if (token == NEG_ZERO_TOKEN) zmm1[i+31:i] = -0 
else if (token == POS_ZERO_TOKEN) zmm1[i+31:i] = +0 
else if (token == POS_INF_TOKEN) zmmi[i+31:i] = +inf 
else if (token == NAN_TOKEN) zmmi[i+31:i] = QNaN_indefinite 
else if (token == MAX_FLOAT_TOKEN) zmm1[i+31:i] = NMAX 
else if (token == MIN_FLOAT_TOKEN) zmm1[it+31:i] = -NMAX 
else if (token == NO_CHANGE_TOKEN) { /* zmmi[i+31:i] remains unchanged */ } 
} 
} 
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SIMD Floating-Point Exceptions 


Invalid. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
NO 


Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 
S5S1Spo || Function: 4 x 32 bits Usage 
000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 
5251509 || Rounding Mode Override Usage 
1xx SAE (Supress-All-Exceptions) , {sae} 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_fixupnan_ps (_m512,__m512,_m512i); 
—m512 _mm512_mask_fixupnan_ps (_m512,_mmask16,__m512,_m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFMADD132PD - Multiply Destination By Second Source and Add To First 
Source Float64 Vectors 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.W1 vfmadd132pd zmm1 {k1}, zmm2, Multiply float64 vector zmm1 and float64 vec- 
98 /r Syea4(zmm3/mz) tor Sg4(zmm3/m;), add the result to float64 


vector zmm2, and store the final result in 
zmm1, under write-mask. 


Description 


Performs an element-by-element multiplication between float64 vector zmm1 and the 
float64 vector result of the swizzle/broadcast/conversion process on memory or vector 
float64 zmm3, then adds the result to float64 vector zmmz2. The final sum is written into 
float64 vector zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if(SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad fe4 (zmm3/m) 


I 


for (n = 0; n < 8; nt++) f{ 
af Cet [ay t= .0) 4 
i = 64*n 
// float64 operation 
zmm1[i+63:i] = zmmi[i+63:i] * tmpSrc3[i+63:i] + zmm2[i+63:i] 
F 
} 
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SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S ¢4 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Register Swizzle: S ¢¢4 


MVEX.EH=0 

S2S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512d _mm512_fmadd_pd (_m512d,_m512d,_m512d); 
_—m512d _mm512_mask_fmadd_pd (__m512d,__mmask8,_m512d,_m512d); 


—m512d _mm512_mask3_fmadd_pd (_m512d,__m512d,__m512d,__mmasks8); 
Exceptions 

Real-Address Mode and Virtual-8086 
#UD Instruction not available in these modes 

Protected and Compatibility Mode 
#UD Instruction not available in these modes 

64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
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in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFMADD132PS - Multiply Destination By Second Source and Add To First 
Source Float32 Vectors 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.W0O vfmadd132ps zmm1 {k1}, zmm2, Multiply float32 vector zmm1 and float32 vec- 
98 /r Sp32(zmm3/mz) tor S'r32(zmm3/m,), add the result to float32 


vector zmm2, and store the final result in 
zmm1, under write-mask. 


Description 


Performs an element-by-element multiplication between float32 vector zmm1 and the 
float32 vector result of the swizzle/broadcast/conversion process on memory or vector 
float32 zmm3, then adds the result to float32 vector zmmz2. The final sum is written into 
float32 vector zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if(SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad p32 (zmm3/m) 


I 


for (n = 0; n < 16; n++) { 
af Cet (al: t=O) f 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = zmmi[i+31:i] * tmpSrc3[it+31:i] + zmm2[i+31:i] 
F 
} 
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SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S;35 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 


Register Swizzle: S¢3» 


MVEX.EH=0 

S551Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_fmadd_ps (_m512,_m512,__m512); 
—m512 _mm512_mask_fmadd_ps (_m512,_mmask16,_m512,__m512); 
—m512 _mm512_mask3_fmadd_ps (_m512,__m512,__m512,__mmask16); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFMADD213PD - Multiply First Source By Destination and Add Second 


Source Float64 Vectors 


Opcode Instruction 
MVEX.NDS.512.66.0F38.W1 A8 /r vfmadd213pd zmm1 {k1}, zmm2, S¢4(zmm3/m,) 


Description 

Multiply float64 
vector zmm2 
and float64 
vector zmm1, 
add the result to 
float64 vector 
Sea(zmm3/m,), 
and store the 
final result in 
zmm1, under 
write-mask. 


Description 


Performs an element-by-element multiplication between float64 vector zmm2 and float64 
vector zmm1 and then adds the result to the float64 vector result of the swizzle/broadcast/conversion 
process on memory or vector float64 zmm3. The final sum is written into float64 vector 


zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 


the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 


// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 


RoundingMode = SSS[1:0] 

tmpSrc3[511:0] = zmm3[511:0] 
} else { 

RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad fe4 (zmm3/m,) 


} 


for (n = 0; n < 8; n++) { 
if(kifn] != 0) { 
i = 64*n 
// float64 operation 
zmm1[i+63:i] = zmm2[i+63:i] * zmm1[i+63:i] + tmpSrc3[i+63:i] 
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SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S 64 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Register Swizzle: S ¢¢4 


MVEX.EH=0 

S2S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512d _mm512_fmadd_pd (_m512d,_m512d,_m512d); 


_—m512d _mm512_mask_fmadd_pd (__m512d,__mmask8,_m512d,_m512d); 


—m512d _mm512_mask3_fmadd_pd (_m512d 


De 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


m512d,__m512d 


a 


mmask8); 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
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#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFMADD213PS - Multiply First Source By Destination and Add Second 
Source Float32 Vectors 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.W0 A8 /r vfmadd213ps zmm1 {k1}, zmm2, S32(zmm3/m;,) Multiply float32 
vector zmm2 


and float32 vec- 
tor zmmi, add 
the result to 
float32 vector 
Sys2(emm3/m,), 
and store’ the 
final result in 
zmm1, under 
write-mask. 


Description 


Performs an element-by-element multiplication between float32 vector zmm2 and float32 

vector zmm1 and then adds the result to the float32 vector result of the swizzle/broadcast/conversion 
process on memory or vector float32 zmm3. The final sum is written into float32 vector 

zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad f32 (zmm3/m;) 


} 


for (n = 0; n < 16; n++) f{ 
if(ki [a]: != 0) 4 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = zmm2[i+31:i] * zmm1[it+31:i] + tmpSrc3[it+31:i] 
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SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S;35 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 
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Register Swizzle: S 3. 


Real-Address Mode and Virtual-8086 


#UD 


Protected and Compatibility Mode 


#UD 


64 bit Mode 


#SS(0) 


Instruction not available in these modes 


Instruction not available in these modes 


MVEX.EH=0 
S2S1So || Function: 4 x 32 bits Usage 
000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 
52515 || Rounding Mode Override Usage 
000 Round To Nearest (even) , {rn} 
001 Round Down (-INF) , {rd} 
010 Round Up (+INF) , {ru} 
011 Round Toward Zero , {rz} 
100 Round To Nearest (even) with SAE , {rn-sae} 
101 Round Down (-INF) with SAE , {rd-sae} 
110 Round Up (+INF) with SAE , {ru-sae} 
111 Round Toward Zero with SAE , {rz-sae} 
Intel’ C/C++ Compiler Intrinsic Equivalent 
—m512 _mm512_fmadd_ps (_m512,__m512,_m512); 
—m512 _mm512_mask_fmadd_ps (_m512,_mmask16,__m512,_m512); 
—m512 _mm512_mask3_fmadd_ps (_m512,__m512,__m512, _mmask16); 
Exceptions 


If a memory address referencing the SS segment is 
in a non-canonical form. 
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#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFMADD231PD - Multiply First Source By Second Source and Add To Des- 
tination Float64 Vectors 
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Opcode Instruction Description 

MVEX.NDS.512.66.0F38.W1 B8 /r vfmadd231pd zmm1 {k1}, zmm2, Sye64(zmm3/m,) Multiply float64 
vector zmm2 and 
float64 vector 
Spoa(zmm3/m4), 
add the result to 
float64 vector 
zmm1, and store 
the final result 
in zmmi1, under 
write-mask. 


Description 


Performs an element-by-element multiplication between float64 vector zmm2 and the 
float64 vector result of the swizzle/broadcast/conversion process on memory or vector 
float64 zmm3, then adds the result to float64 vector zmm1. The final sum is written into 
float64 vector zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad fe4 (zmm3/m) 


} 


for (n = 0; n < 8; n++) { 
if(kifm] != 0) f 
i = 64*n 
// float64 operation 
zmm1[i+63:i] = zmm2[i+63:i] * tmpSrc3[i+63:i] + zmm1[i+63:i] 
} 
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SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S 64 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Register Swizzle: S ¢¢4 


MVEX.EH=0 

S2S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512d _mm512_fmadd_pd (_m512d,_m512d,_m512d); 


_—m512d _mm512_mask_fmadd_pd (__m512d,__mmask8,_m512d,_m512d); 


—m512d _mm512_mask3_fmadd_pd (_m512d 


De 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


m512d,__m512d 


a 


mmask8); 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
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#GP(0) 


#PF(fault-code) 
#NM 
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in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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Opcode Instruction Description 

MVEX.NDS.512.66.0F38.W0 B8 /r vfmadd231ps zmm1 {k1}, zmm2, S'32(zmm3/m;) Multiply float32 
vector zmm2 and 
float32 vector 
S¢32(zmm3/mz), 
add the result to 
float32 vector 
zmm1, and store 
the final result 
in zmmi1, under 
write-mask. 


Description 


Performs an element-by-element multiplication between float32 vector zmm2 and the 
float32 vector result of the swizzle/broadcast/conversion process on memory or vector 
float32 zmm3, then adds the result to float32 vector zmm1. The final sum is written into 
float32 vector zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad f32 (zmm3/m) 


} 


for (n = 0; n < 16; n++) f{ 
if(ki{m] != 0) f{ 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = zmm2[i+31:i] * tmpSrc3[it+31:i] + zmm1[it+31:i] 
} 
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SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 


Reference Number: 327364-001 221 


CHAPTER 6. INSTRUCTION DESCRIPTIONS 


> 
D 


222 


Register Swizzle: S 3. 


Real-Address Mode and Virtual-8086 


#UD 


Protected and Compatibility Mode 


#UD 


64 bit Mode 


#SS(0) 


Instruction not available in these modes 


Instruction not available in these modes 


MVEX.EH=0 
S2S1So || Function: 4 x 32 bits Usage 
000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 
52515 || Rounding Mode Override Usage 
000 Round To Nearest (even) , {rn} 
001 Round Down (-INF) , {rd} 
010 Round Up (+INF) , {ru} 
011 Round Toward Zero , {rz} 
100 Round To Nearest (even) with SAE , {rn-sae} 
101 Round Down (-INF) with SAE , {rd-sae} 
110 Round Up (+INF) with SAE , {ru-sae} 
111 Round Toward Zero with SAE , {rz-sae} 
Intel’ C/C++ Compiler Intrinsic Equivalent 
—m512 _mm512_fmadd_ps (_m512,__m512,_m512); 
—m512 _mm512_mask_fmadd_ps (_m512,_mmask16,__m512,_m512); 
—m512 _mm512_mask3_fmadd_ps (_m512,__m512,__m512, _mmask16); 
Exceptions 


If a memory address referencing the SS segment is 
in a non-canonical form. 
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#GP(0) 


#PF(fault-code) 
#NM 
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If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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and Add To Second Source Float32 Vectors 
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Opcode 
MVEX.NDS.512.66.0F38.W0 A4 /r 


Instruction 
vfmadd233ps zmm1 {k1}, zmm2, S'f32(zmm3/m,) 


Description 

Multiply float32 
vector zmm2 by 
certain elements 
of float32 vector 
Sys2(amm3/m,), 
add__—sitthe re- 
sult to certain 
elements of 
Sp32(zmm3/m,z), 
and store’ the 
final result in 
zmm1, under 
write-mask. 


Description 


This instruction is built around the concept of 4-element sets, of which there are four: 
elements 0-3, 4-7, 8-11, and 12-15. If we refer to the float32 vector result of the broadcast 
(no conversion is supported) process on memory or the float32 vector zmm3 (no swizzle 
is supported) as t3, then: 


Each element 0-3 of float32 vector zmm2 is multiplied by element 1 of t3, the result is 
added to element 0 of t3, and the final sum is written into the corresponding element 0-3 
of float32 vector zmm1. 


Each element 4-7 of float32 vector zmm2 is multiplied by element 5 of t3, the result is 
added to element 4 of t3, and the final sum is written into the corresponding element 4-7 
of float32 vector zmm1. 


Each element 8-11 of float32 vector zmm2 is multiplied by element 9 of t3, the result is 
added to element 8 of t3, and the final sum is written into the corresponding element 8-11 
of float32 vector zmm1. 


Each element 12-15 of float32 vector zmm2 is multiplied by element 13 of t3, the result 
is added to element 12 of t3, and the final sum is written into the corresponding element 
12-15 of float32 vector zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 


This instruction makes it possible to perform scale and bias in a single instruction without 
needing to have either scale or bias already loaded in a register. This saves one vector load 
for each interpolant, representing around ten percent of shader instructions. 


For structure-of-arrays (SOA) operation, this instruction is intended to be used with the 
{4to16} broadcast on src2, allowing all 16 scale and biases to be identical. For array-of- 
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structures (AOS) vec4 operations, no broadcast is used, allowing four different scales and 
biases, one for each vec4. 


No conversion or swizzling is supported for this instruction. However, all broadcasts ex- 
cept {1to16} are supported (i.e. 16to16 and 4to16). 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad p32 (zmm3/m,) 


} 


for (n = 0; n < 16; n++) { 
if (ki[n] -!= 0) 4 
i = 32*n 
base = ( n & ~0x03 ) * 32 
scale[31:0] = tmpSrc3[baset63:base+32] 
bias [31:0] = tmpSrc3[base+31: base] 
// float32 operation 
zmm1[i+31:i] = zmm2[i+31:i] * scale[31:0] + bias[31:0] 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 
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Memory Up-conversion: S;35 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 reserved N/A N/A 
010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Register Swizzle: Ss» 


MVEX.EH=0 

S255 || Function: 4 x 32 bits Usage 
000 no swizzle zmm0 or zmm0 {dcba} 
001 reserved N/A 

010 reserved N/A 

011 reserved N/A 

100 reserved N/A 

101 reserved N/A 

110 reserved N/A 

111 reserved N/A 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 
000 Round To Nearest (even) , {rn} 
001 Round Down (-INF) , {rd} 
010 Round Up (+INF) , {ru} 
011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 
101 Round Down (-INF) with SAE , {rd-sae} 
110 Round Up (+INF) with SAE , {ru-sae} 
111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_fmadd233_ps (_m512,__m512); 
—m512 _mm512_mask_fmadd233_ps (_m512,_mmask16,__m512,__m512); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 

in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to 16 or 64-byte (depending on the swizzle broadcast). 
For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 

This instruction does not support any 

SwizzUpConv involving data conversion, register swizzling or 
{1to16} broadcast. If SwizzUpConv function is set to any 
value different than "no action" or {4to16} then 

an Invalid Opcode fault is raised 
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VFMSUB132PD - Multiply Destination By Second Source and Subtract 
First Source Float64 Vectors 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.W1 vfmsub132pd zmm1 {k1}, zmm2, Multiply float64 vector zmm1 and float64 vec- 
9A /r Sea(zmm3/mz) tor Syg4(zmm3/m;), subtract float64 vector 


zmmz2 from the result, and store the final result 
in zmm1, under write-mask. 


Description 


Performs an element-by-element multiplication of float64 vector zmm1 and the float64 
vector result of the swizzle/broadcast/conversion process on memory or vector float64 
zmm3, then subtracts float64 vector zmm2 from the result. The final result is written into 
float64 vector zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad f¢4 (zmm3/m,) 


} 


for (n = 0; n < 8; nt++) f{ 
if(ki{m] != 0) f 
i = 64*n 
// float64 operation 
zmm1[i+63:i] = zmmi[i+63:i] * tmpSrc3[i+63:i] - zmm2[i+63:i] 
} 
} 
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SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S ¢4 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Register Swizzle: S ¢¢4 


MVEX.EH=0 

S2S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512d _mm512_fmsub_pd (_m512d,_m512d,_m512d); 
_—m512d _mm512_mask_fmsub_pd (_.m512d,_mmask8,_m512d,_m512d); 
—m512d _mm512_mask3_fmsub_pd (_.m512d,__m512d,__m512d, _mmask8); 


; on 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 


Reference Number: 327364-001 


= 
=r 
é 


CHAPTER 6. INSTRUCTION DESCRIPTIONS 


#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFMSUB132PS - Multiply Destination By Second Source and Subtract First 
Source Float32 Vectors 
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Opcode Instruction Description 
MVEX.NDS.512.66.0F38.W0O vfmsub132ps zmm1 {k1}, zmm2, Multiply float32 vector zmm1 and float32 vec- 
9A /r S'p32(zmm3/mz) tor Sy32(zmm3/m;), subtract float32 vector 


zmm_2 from the result, and store the final result 
in zmm1, under write-mask. 


Description 


Performs an element-by-element multiplication of float32 vector zmm1 and the float32 
vector result of the swizzle/broadcast/conversion process on memory or vector float32 
zmm3, then subtracts float32 vector zmm2 from the result. The final result is written into 
float32 vector zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad f32 (zmm3/m,) 


} 


for (n = 0; n < 16; n++) f{ 
if(ki{m] != 0) f 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = zmmi[i+31:i] * tmpSrc3[it+31:i] - zmm2[i+31:i] 
} 
} 
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SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S;35 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 


Register Swizzle: S¢3» 


MVEX.EH=0 

S551Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_fmsub_ps (_m512,_m512,__m512); 
—m512 _mm512_mask_fmsub_ps (_m512,_mmask16,_m512,__m512); 
—m512 _mm512_mask3_fmsub_ps (_m512,_m512,__m512,__mmask16); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFMSUB213PD - Multiply First Source By Destination and Subtract Sec- 
ond Source Float64 Vectors 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.W1 vfmsub213pd zmm1 {k1}, zmm2, Multiply float64 vector zmm2 and float64 
AA /r Sea(zmm3/mz) vector zmm1, _ subtract float64 vector 


Srea(zmm3/m,) from the result, and store 
the final result in zmm1, under write-mask. 


Description 


Performs an element-by-element multiplication of float64 vector zmm2 and float64 vec- 
tor zmm1, then subtracts the float64 vector result of the swizzle/broadcast/conversion 
process on memory or vector float64 zmm3 from the result. The final result is written 
into float64 vector zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad f¢4 (zmm3/m,) 


} 


for (n = 0; n < 8; nt++) f{ 
if(ki{m] != 0) f 
i = 64*n 
// float64 operation 
zmm1[i+63:i] = zmm2[i+63:i] * zmm1[i+63:i] - tmpSrc3[i+63:i] 
} 
} 
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SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S ¢4 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Register Swizzle: S ¢¢4 


MVEX.EH=0 

S2S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512d _mm512_fmsub_pd (_m512d,_m512d,_m512d); 
_—m512d _mm512_mask_fmsub_pd (_.m512d,_mmask8,_m512d,_m512d); 
—m512d _mm512_mask3_fmsub_pd (_.m512d,__m512d,__m512d, _mmask8); 


; on 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
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in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFMSUB213PS - Multiply First Source By Destination and Subtract Second 
Source Float32 Vectors 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.W0O vfmsub213ps zmm1 {k1}, zmm2, Multiply float32 vector zmm2 and _ float32 
AA /r S'p32(zmm3/mz) vector zmm1, _ subtract float32 vector 


Sf32(zmm3/m,) from the result, and store 
the final result in zmm1, under write-mask. 


Description 


Performs an element-by-element multiplication of float32 vector zmm2 and float32 vec- 
tor zmm1, then subtracts the float32 vector result of the swizzle/broadcast/conversion 
process on memory or vector float32 zmm3 from the result. The final result is written 
into float32 vector zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad f32 (zmm3/m,) 


} 


for (n = 0; n < 16; n++) f{ 
if(ki{m] != 0) f{ 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = zmm2[i+31:i] * zmm1[it+31:i] - tmpSrc3[it+31:i] 
} 
} 
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SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S;35 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 


Register Swizzle: S¢3» 


MVEX.EH=0 

S551Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_fmsub_ps (_m512,_m512,__m512); 
—m512 _mm512_mask_fmsub_ps (_m512,_mmask16,_m512,__m512); 
—m512 _mm512_mask3_fmsub_ps (_m512,_m512,__m512,__mmask16); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFMSUB231PD - Multiply First Source By Second Source and Subtract 
Destination Float64 Vectors 
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Opcode Instruction Description 
MVEX.NDS.512.66.0F38.W1 vfmsub231pd zmm1 {k1}, zmm2, Multiply float64 vector zmm2 and float64 vec- 
BA /r Sea(zmm3/mz) tor Syg4(zmm3/m;), subtract float64 vector 


zmm1 from the result, and store the final result 
in zmm1, under write-mask. 


Description 


Performs an element-by-element multiplication of float32 vector zmm2 and the float32 
vector result of the swizzle/broadcast/conversion process on memory or vector float32 
zmm3, then subtracts float32 vector zmm1 from the result. The final result is written into 
float32 vector zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad f¢4 (zmm3/m,) 


} 


for (n = 0; n < 8; nt++) f{ 
if(ki{m] != 0) f 
i = 64*n 
// float64 operation 
zmm1[i+63:i] = zmm2[i+63:i] * tmpSrc3[it+63:i] - zmm1[i+63:i] 
} 
} 
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SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S ¢4 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Register Swizzle: S ¢¢4 


MVEX.EH=0 

S2S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512d _mm512_fmsub_pd (_m512d,_m512d,_m512d); 
_—m512d _mm512_mask_fmsub_pd (_.m512d,_mmask8,_m512d,_m512d); 
—m512d _mm512_mask3_fmsub_pd (_.m512d,__m512d,__m512d, _mmask8); 


; on 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
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#GP(0) 


#PF(fault-code) 
#NM 
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in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFMSUB231PS - Multiply First Source By Second Source and Subtract Des- 
tination Float32 Vectors 
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Opcode Instruction Description 
MVEX.NDS.512.66.0F38.W0O vfmsub231ps zmm1 {k1}, zmm2, Multiply float32 vector zmm2 and float32 vec- 
BA /r S'p32(zmm3/mz) tor Sy32(zmm3/m;), subtract float32 vector 


zmm1 from the result, and store the final result 
in zmm1, under write-mask. 


Description 


Performs an element-by-element multiplication of float32 vector zmm2 and the float32 
vector result of the swizzle/broadcast/conversion process on memory or vector float32 
zmm3, then subtracts float32 vector zmm1 from the result. The final result is written into 
float32 vector zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad f32 (zmm3/m,) 


} 


for (n = 0; n < 16; n++) f{ 
if(ki{m] != 0) f{ 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = zmm2[i+31:i] * tmpSrc3[it+31:i] - zmm1[it+31:i] 
} 
} 
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SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S;35 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 


Register Swizzle: S¢3» 


MVEX.EH=0 

S551Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_fmsub_ps (_m512,_m512,__m512); 
—m512 _mm512_mask_fmsub_ps (_m512,_mmask16,_m512,__m512); 
—m512 _mm512_mask3_fmsub_ps (_m512,_m512,__m512,__mmask16); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


248 


Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFNMADD132PD - Multiply Destination By Second Source and Subtract 
From First Source Float64 Vectors 


Opcode 
MVEX.NDS.512.66.0F38.W1 9C /r vfnmadd132pd zmm1 {k1}, zmm2, Sy64(zmm3/m) 


Instruction 


Description 
Multiply 
float64 vec- 
tor zmm1 and 
float64 vector 
Srea(zmm3/mz), 
negate, and add 
the result to 
float64 vector 
zmmz2, and 
store the fi- 
nal result in 
zmmi, under 
write-mask. 


Description 


Performs an element-by-element multiplication of float64 vector zmm2 and the float64 
vector result of the swizzle/broadcast/conversion process on memory or vector float64 
zmm3, then subtracts the result from float64 vector zmm1. The final result is written into 


float64 vector zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 


i 


for (n 
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if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode 
tmpSrc3[511:0] = zmm3[511:0] 
} else { 
RoundingMode 
tmpSrc3[511:0 


SS[1:0] 


XCSR.RC 
SwizzUpConvLoad fo4 (zmm3/m,) 


0; n < 8; nt+) { 
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i = 64*n 
// float64 operation 
zmm1[i+63:i] = -(zmm1[i+63:i] * tmpSrc3[i+63:i]) + zmm2[i+63:i] 


} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 


(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 


(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S 64 


525159 


Function: 


Usage 


disp8*N 


000 
001 
010 
011 
100 
101 
110 
111 


no conversion 

broadcast 1 element (x8) 
broadcast 4 elements (x2) 
reserved 

reserved 

reserved 

reserved 

reserved 


[rax] {8to8} or [rax] 
[rax] {1to8} 

[rax] {4to8} 

N/A 

N/A 

N/A 

N/A 

N/A 


64 
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Register Swizzle: S ¢¢4 


MVEX.EH=0 

S2S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512d _mm512_fnmadd_pd (_m512d,__m512d,__m512d); 
_—m512d _mm512_mask_fnmadd_pd (_m512d,_mmask8,_m512d,_m512d); 
_—m512d _mm512_mask3_fnmadd_pd (_m512d,__m512d,__m512d,__mmask8); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
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in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFNMADD132PS - Multiply Destination By Second Source and Subtract 
From First Source Float32 Vectors 


Opcode 
MVEX.NDS.512.66.0F38.W0 9C /r vfnmadd132ps zmm1 {k1}, zmm2, S'f32(zmm3/m;) 


Instruction 


Description 
Multiply 
float32 vec- 
tor zmmi1 and 
float32 vector 
Sf32(zmm3/mz), 
negate, and add 
the result to 
float32 vector 
zmmz2, and 
store the fi- 
nal result in 
zmmi, under 
write-mask. 


Description 


Performs an element-by-element multiplication of float32 vector zmm2 and the float32 
vector result of the swizzle/broadcast/conversion process on memory or vector float32 
zmm3, then subtracts the result from float32 vector zmm1. The final result is written into 


float32 vector zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 


i 


for (n 
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S) 


M 


if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode 
tmpSrc3[511:0] = zmm3[511:0] 
} else { 
RoundingMode 
tmpSrc3[511:0 


SS[1:0] 


XCSR.RC 
SwizzUpConvLoad p32 (zmm3/m) 


0; n < 16; n++) { 
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i = 32*n 
// float32 operation 
zmm1[i+31:i] = -(zmmi[it31:i] * tmpSrc3[it+31:i]) + zmm2[it+31:i] 


} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S;35 


S251 So 


Function: 


Usage 


disp8*N 


000 
001 
010 
011 
100 
110 
111 


no conversion 

broadcast 1 element (x16) 
broadcast 4 elements (x4) 
float16 to float32 

uint8 to float32 

uint16 to float32 

sint16 to float32 


[rax] {16to16} or [rax] 
[rax] {1to16} 

[rax] {4to16} 

[rax] {float16} 

[rax] {uint8} 

[rax] {uint16} 

[rax] {sint16} 


64 
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Register Swizzle: S;3. 


MVEX.EH=0 

S2S1So || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_fnmadd_ps (_m512,_m512,__m512); 
—m512 _mm512_mask_fnmadd_ps (_m512,_mmask16,_m512,__m512); 


—m512 _mm512_mask3_fnmadd_ps (_m512,__m512,__m512,__mmask16); 
Exceptions 

Real-Address Mode and Virtual-8086 
#UD Instruction not available in these modes 

Protected and Compatibility Mode 
#UD Instruction not available in these modes 

64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 


in a non-canonical form. 
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#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFNMADD213PD - Multiply First Source By Destination and Subtract From 
Second Source Float64 Vectors 


Opcode 
MVEX.NDS.512.66.0F38.W1 AC /r vfnmadd213pd zmm1 {k1}, zmm2, S'¢g4(zmm3/m;) 


Instruction 


Description 

Multiply float64 
vector zmm2 
and float64 
vector zmm1, 
negate, and add 
the result to 
float64 vector 
Syea(zmm3/m,), 
and store the 
final result in 
zmmi, under 
write-mask. 


Description 


Performs an element-by-element multiplication of float64 vector zmm1 and the float64 
vector result of the swizzle/broadcast/conversion process on memory or vector float64 
zmm3, then subtracts the result from float64 vector zmm2. The final result is written into 


float64 vector zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 


} 


M 


if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else { 
RoundingMode 
tmpSrc3[511:0 


XCSR.RC 
SwizzUpConvLoad fg (zmm3/m,) 


for (n = 0; n < 8; nt+t+) { 
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// float64 operation 
zmm1[i+63:i] = -(zmm2[i+63:i] * zmm1i[i+63:i]) + tmpSrc3[it+63:i] 


} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 


(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 


(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S 64 


525150 


Function: 


Usage 


disp8*N 


000 
001 
010 
011 
100 
101 
110 
111 


no conversion 

broadcast 1 element (x8) 
broadcast 4 elements (x2) 
reserved 

reserved 

reserved 

reserved 

reserved 


[rax] {8to8} or [rax] 
[rax] {1to8} 

[rax] {4to8} 

N/A 

N/A 

N/A 

N/A 

N/A 


64 
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Register Swizzle: S ¢¢4 


MVEX.EH=0 

S2S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512d _mm512_fnmadd_pd (_m512d,__m512d,__m512d); 
_—m512d _mm512_mask_fnmadd_pd (_m512d,_mmask8,_m512d,_m512d); 
_—m512d _mm512_mask3_fnmadd_pd (_m512d,__m512d,__m512d,__mmask8); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
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in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFNMADD213PS - Multiply First Source By Destination and Subtract From 
Second Source Float32 Vectors 


Opcode 
MVEX.NDS.512.66.0F38.W0 AC /r vfnmadd213ps zmm1 {k1}, zmm2, Sy32(zmm3/m) 


Instruction 


Description 

Multiply float32 
vector zmm2 
and float32 
vector zmm1l, 
negate, and 
add the result 
to float32 vector 
Sys2(amm3/m,), 
and store the 
final result in 
zmmi, under 
write-mask. 


Description 


Performs an element-by-element multiplication of float32 vector zmm1 and the float32 
vector result of the swizzle/broadcast/conversion process on memory or vector float32 
zmm3, then subtracts the result from float32 vector zmm2. The final result is written into 


float32 vector zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 


} 


M 


if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else { 
RoundingMode 
tmpSrc3[511:0 


XCSR.RC 
SwizzUpConvLoad f32 (zmm3/m,) 


for (n = 0; n < 16; n++) { 
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// float32 operation 
zmm1[i+31:i] = -(zmm2[i+31:i] * zmmi[i+31:i]) + tmpSrc3[it31:i] 


} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S35 


52515 


Function: 


Usage 


disp8*N 


000 
001 
010 
011 
100 
110 
111 


no conversion 

broadcast 1 element (x16) 
broadcast 4 elements (x4) 
float16 to float32 

uint8 to float32 

uint16 to float32 

sint16 to float32 


[rax] {16to16} or [rax] 
[rax] {1to16} 

[rax] {4to16} 

[rax] {float16} 

[rax] {uint8} 

[rax] {uint16} 

[rax] {sint16} 


64 
4 

16 
32 
16 
32 
32 
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Register Swizzle: S;3. 


MVEX.EH=0 

S2S1So || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_fnmadd_ps (_m512,_m512,__m512); 
—m512 _mm512_mask_fnmadd_ps (_m512,_mmask16,_m512,__m512); 


—m512 _mm512_mask3_fnmadd_ps (_m512,__m512,__m512,__mmask16); 
Exceptions 

Real-Address Mode and Virtual-8086 
#UD Instruction not available in these modes 

Protected and Compatibility Mode 
#UD Instruction not available in these modes 

64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 


in a non-canonical form. 
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#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFNMADD231PD - Multiply First Source By Second Source and Subtract 
From Destination Float64 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.W1 BC /r vfnmadd231pd zmm1 {k1}, zmm2, Syg4(zmm3/m;) Multiply 
float64 vec- 
tor zmm2 and 
float64 vector 
Syea(zmm3/m,), 
negate, and add 
the result to 
float64 vector 
zmm1, and 
store the fi- 
nal result in 
zmmi, under 
write-mask. 


Description 


Performs an element-by-element multiplication of float64 vector zmm2 and float64 vec- 

tor zmm1, then subtracts the result from the float64 vector result of the swizzle/broadcast/conversion 
process on memory or vector float64 zmm3. The final result is written into float64 vector 

zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad fo4 (zmm3/m,) 


i 


for (n = 0; n < 8; nt+) { 
if(ki[n] != 0) { 
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i = 64*n 
// float64 operation 
zmm1[i+63:i] = -(zmm2[i+63:i] * tmpSrc3[it+63:i]) + zmm1[it+63:i] 


} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 


(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 


(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S 64 


525159 


Function: 


Usage 


disp8*N 


000 
001 
010 
011 
100 
101 
110 
111 


no conversion 

broadcast 1 element (x8) 
broadcast 4 elements (x2) 
reserved 

reserved 

reserved 

reserved 

reserved 


[rax] {8to8} or [rax] 
[rax] {1to8} 

[rax] {4to8} 

N/A 

N/A 

N/A 

N/A 

N/A 


64 
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Register Swizzle: S ¢¢4 


MVEX.EH=0 

S2S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512d _mm512_fnmadd_pd (_m512d,__m512d,__m512d); 
_—m512d _mm512_mask_fnmadd_pd (_m512d,_mmask8,_m512d,_m512d); 
_—m512d _mm512_mask3_fnmadd_pd (_m512d,__m512d,__m512d,__mmask8); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
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in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFNMADD231PS - Multiply First Source By Second Source and Subtract 
From Destination Float32 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.W0 BC /r vfnmadd231ps zmm1 {k1}, zmm2, Sy32(zmm3/m;) Multiply 
float32 vec- 
tor zmm2 and 
float32 vector 
Sp32(zmm3/mz), 
negate, and add 
the result to 
float32 vector 
zmm1, and 
store the  fi- 
nal result in 
zmmi, under 
write-mask. 


Description 


Performs an element-by-element multiplication of float32 vector zmm2 and float32 vec- 

tor zmm1, then subtracts the result from the float32 vector result of the swizzle/broadcast/conversion 
process on memory or vector float32 zmm3. The final result is written into float32 vector 

zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad p32 (zmm3/m) 


i 


for (n = 0; n < 16; n++) { 
if(ki[n] != 0) { 
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i = 32*n 
// float32 operation 
zmm1[i+31:i] = -(zmm2[i+31:i] * tmpSrc3[it+31:i]) + zmm1[it31:i] 


} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S;35 


S251 So 


Function: 


Usage 


disp8*N 


000 
001 
010 
011 
100 
110 
111 


no conversion 

broadcast 1 element (x16) 
broadcast 4 elements (x4) 
float16 to float32 

uint8 to float32 

uint16 to float32 

sint16 to float32 


[rax] {16to16} or [rax] 
[rax] {1to16} 

[rax] {4to16} 

[rax] {float16} 

[rax] {uint8} 

[rax] {uint16} 

[rax] {sint16} 
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Register Swizzle: S;3. 


MVEX.EH=0 

S2S1So || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_fnmadd_ps (_m512,_m512,__m512); 
—m512 _mm512_mask_fnmadd_ps (_m512,_mmask16,_m512,__m512); 


—m512 _mm512_mask3_fnmadd_ps (_m512,__m512,__m512,__mmask16); 
Exceptions 

Real-Address Mode and Virtual-8086 
#UD Instruction not available in these modes 

Protected and Compatibility Mode 
#UD Instruction not available in these modes 

64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 


in a non-canonical form. 
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#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFNMSUB132PD - Multiply Destination By Second Source, Negate, and 
Subtract First Source Float64 Vectors 


Opcode 


MVEX.NDS.512.66.0F38.W1 9E /r 


Instruction 
vfnmsub132pd zmm1 {k1}, zmm2, Sfe4(zmm3/m,) 


Description 
Multiply 
float64 vec- 
tor zmm1 and 
float64 vector 
Syea(zmm3/m,), 
negate, and sub- 
tract float64 
vector zmm2 
from the result, 
and store the 
final result in 


zmmi, under 
write-mask. 
Description 
Performs an element-by-element multiplication between float64 vector zmm1 and the 
float64 vector result of the swizzle/broadcast/conversion process on memory or vector 
float64 zmm3, negates, and subtracts float64 vector zmmz2. The final result is written into 
float64 vector zmm1. 
Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 
x*y Zz RN/RU/RZ RD 
+0 +0 || GO) + G0) =-0)) GO) eb) | 6=-0 
+0 -0 |) (0) +(+0) =+0) (0) +(+0) =-0 
0 +0 |) GO) +(-0) =+0) (+0) +(-0) =-0 
-0 -0 (+0) +(+0) =+0) (+0) +(+0) =+0 
Table 6.11: VFNMSUB outcome when adding zeros depending on rounding-mode 
This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 
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Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if(SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad fe4 (zmm3/m;) 


} 


for (n = 0; n < 8; nt++) { 
a Get [ay 1=.0) 4 
i = 64*n 
// float64 operation 
zmm1[i+63:i] = (-(zmm1[i+63:i] * tmpSrc3[i+63:i]) - zmm2[i+63:i]) 
} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S ¢4 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Register Swizzle: S ¢¢4 


MVEX.EH=0 

S2S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512d _mm512_fnmsub_pd (_m512d,__m512d,__m512d); 
_—m512d _mm512_mask_fnmsub_pd (_m512d,_mmask8,_m512d,__m512d); 
_—m512d _mm512_mask3_fnmsub_pd (_m512d,__m512d,_m512d, _mmask8); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
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in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFNMSUB132PS - Multiply Destination By Second Source, Negate, and 
Subtract First Source Float32 Vectors 


Opcode 


MVEX.NDS.512.66.0F38.W0 9E /r 


Instruction 
vfnmsub132ps zmm1 {k1}, zmm2, S'f32(zmm3/m;z) 


Description 
Multiply 
float32 vec- 
tor zmm1 and 
float32 vector 
Sf32(zmm3/mz«), 
negate, and sub- 
tract float32 
vector zmm2 
from the result, 
and store the 


final result in 
zmmi, under 
write-mask. 
Description 
Performs an element-by-element multiplication between float32 vector zmm1 and the 
float32 vector result of the swizzle/broadcast/conversion process on memory or vector 
float32 zmm3, negates, and subtracts float32 vector zmmz2. The final result is written into 
float32 vector zmm1. 
Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 
x*y Zz RN/RU/RZ RD 
+0 +0 || GO) + G0) =-0)) GO) eb) | 6=-0 
+0 -0 |) (0) +(+0) =+0) (0) +(+0) =-0 
0 +0 |) GO) +(-0) =+0) (+0) +(-0) =-0 
-0 -0 (+0) +(+0) =+0) (+0) +(+0) =+0 
Table 6.12: VFNMSUB outcome when adding zeros depending on rounding-mode 
This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 
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Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad p32 (zmm3/m) 


I 


for (n = 0; n < 16; n++) f{ 
if(kifm] != 0) f 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = (-(zmm1[i+31:i] * tmpSrc3[i+31:i]) - zmm2[i+31:i]) 
} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S;35 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 
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Register Swizzle: S;3. 


MVEX.EH=0 

S2S1So || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512 _mm512_fnmsub_ps (_m512,_m512,__m512); 
—m512 _mm512_mask_fnmsub_ps (_m512,_mmask16,__m512,_m512); 
—m512 _mm512_mask3_fnmsub_ps (_m512,__m512,__m512,__mmask16); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 


in a non-canonical form. 
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#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFNMSUB213PD - Multiply First Source By Destination, Negate, and Sub- 
tract Second Source Float64 Vectors 


Opcode 
MVEX.NDS.512.66.0F38.W1 AE /r 


Instruction 


vfnmsub213pd zmm1 {k1}, zmm2, Se4(zmm3/m,) 


Description 
Multiply float64 
vector zmm2 
and float64 
vector zmm1l, 
negate, and 
subtract 
float64 vector 
Spoa(zmm3/mz) 
from the result, 
and store the 
final result in 
zmmi, under 
write-mask. 


Description 


Performs an element-by-element multiplication between float64 vector zmm2 and float64 
vector zmm1, negates, and subtracts the float64 vector result of the swizzle/broadcast/conversion 
process on memory or vector float64 zmm3. The final sum is written into float64 vector 


zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 


x*y Zz RN/RU/RZ RD 

+0 +0 |] (0) +(-0) =-0 | (-0) +(-0) =-0 
+0 -0 | (0) +(+0) =+0) (0) +(+0) =-0 
0 =+0 | (40) +(-0) =+0) (+0) +(-0) =-0 
-0 -0 (+0) +(+0) =+0) (+0) +(+0) =+0 


Table 6.13: VFNMSUB outcome when adding zeros depending on rounding-mode 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 
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Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if(SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad fe4 (zmm3/m;) 


} 


for (n = 0; n < 8; nt++) { 
a Get [ay 1=.0) 4 
i = 64*n 
// float64 operation 
zmm1[i+63:i] = (-(zmm2[i+63:i] * zmm1[i+63:i]) - tmpSrc3[i+63:i]) 
} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S ¢4 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Register Swizzle: S ¢¢4 


MVEX.EH=0 

S2S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512d _mm512_fnmsub_pd (_m512d,__m512d,__m512d); 
_—m512d _mm512_mask_fnmsub_pd (_m512d,_mmask8,_m512d,__m512d); 
_—m512d _mm512_mask3_fnmsub_pd (_m512d,__m512d,_m512d, _mmask8); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
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in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFNMSUB213PS - Multiply First Source By Destination, Negate, and Sub- 
tract Second Source Float32 Vectors 


Opcode 


MVEX.NDS.512.66.0F38.W0 AE /r 


Instruction 


vfnmsub213ps zmm1 {k1}, zmm2, S'¢32(zmm3/mz) 


Description 
Multiply 
float32 vec- 
tor zmm2 and 
float32 vector 
zmm1, negate, 
and subtract 
float32 vector 
Sf32(zmm3/me) 
from the result, 
and store the 
final result in 
zmmi, under 
write-mask. 


Description 


Performs an element-by-element multiplication between float32 vector zmmz2 and float32 
vector zmm1, negates, and subtracts the float32 vector result of the swizzle/broadcast/conversion 
process on memory or vector float32 zmm3. The final sum is written into float32 vector 


zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 


x*y Zz RN/RU/RZ RD 

+0 +0 |] (0) +(-0) =-0 | (-0) +(-0) =-0 
+0 -0 | (0) +(+0) =+0) (0) +(+0) =-0 
0 =+0 | (40) +(-0) =+0) (+0) +(-0) =-0 
-0 -0 (+0) +(+0) =+0) (+0) +(+0) =+0 


Table 6.14: VFNMSUB outcome when adding zeros depending on rounding-mode 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 
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Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad p32 (zmm3/m) 


I 


for (n = 0; n < 16; n++) f{ 
if(kifm] != 0) f 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = (-(zmm2[i+31:i] * zmmi[it31:i]) - tmpSrc3[i+31:i]) 
} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S;35 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 
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Register Swizzle: S;3. 


MVEX.EH=0 

S2S1So || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512 _mm512_fnmsub_ps (_m512,_m512,__m512); 
—m512 _mm512_mask_fnmsub_ps (_m512,_mmask16,__m512,_m512); 
—m512 _mm512_mask3_fnmsub_ps (_m512,__m512,__m512,__mmask16); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 


in a non-canonical form. 
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#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFNMSUB231PD - Multiply First Source By Second Source, Negate, and 
Subtract Destination Float64 Vectors 


Opcode 


MVEX.NDS.512.66.0F38.W1 BE /r 


Instruction 


vfnmsub231pd zmm1 {k1}, zmm2, S¢4(zmm3/m,) 


Description 
Multiply 
float64 vec- 
tor zmm2 and 
float64 vector 
Spea(zmm3/mz), 
negate, and 
subtract float64 
vector zmm1l 
from the result, 
and store the 
final result in 
zmmi, under 
write-mask. 


Description 


Performs an element-by-element multiplication between float64 vector zmm2 and the 
float64 vector result of the swizzle/broadcast/conversion process on memory or vector 
float64 zmm3, negates, and subtracts float64 vector zmm1. The final result is written into 


float64 vector zmm1. 


Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 


x*y Zz RN/RU/RZ RD 

+0 +0 |] (0) +(-0) =-0 | (-0) +(-0) =-0 
+0 -0 | (0) = +(+0) =+0) (0) +(+0) =-0 
0 =+0 | (40) +(-0) =+0) (+0) +(-0) =-0 
-0 -0 (+0) +(+0) =+0) (+0) +(+0) =+0 


Table 6.15: VFMADDN outcome when adding zeros depending on rounding-mode 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 
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Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if(SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad fe4 (zmm3/m;) 


} 


for (n = 0; n < 8; nt++) { 
a Get [ay 1=.0) 4 
i = 64*n 
// float64 operation 
zmm1[i+63:i] = (-(zmm2[i+63:i] * tmpSrc3[i+63:i]) - zmm1[i+63:i]) 
} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S ¢4 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Register Swizzle: S ¢¢4 


MVEX.EH=0 

S2S1So || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512d _mm512_fnmsub_pd (_m512d,__m512d,__m512d); 
_—m512d _mm512_mask_fnmsub_pd (_m512d,_mmask8,_m512d,__m512d); 
_—m512d _mm512_mask3_fnmsub_pd (_m512d,__m512d,_m512d, _mmask8); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
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in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VFNMSUB231PS - Multiply First Source By Second Source, Negate, and 
Subtract Destination Float32 Vectors 


Opcode 


MVEX.NDS.512.66.0F38.W0 BE /r 


Instruction 


vfnmsub231ps zmm1 {k1}, zmm2, Sp32(zmm3/m;) 


Description 
Multiply 
float32 vec- 
tor zmm2 and 
float32 vector 
Sf32(zmm3/mz), 
negate, and sub- 
tract float32 
vector zmm1 
from the result, 
and store the 
final result in 


zmmi, under 
write-mask. 
Description 
Performs an element-by-element multiplication between float32 vector zmm2 and the 
float32 vector result of the swizzle/broadcast/conversion process on memory or vector 
float32 zmm3, negates, and subtracts float32 vector zmm1. The final result is written into 
float32 vector zmm1. 
Intermediate values are calculated to infinite precision, and are not truncated or rounded. 
All operations must be performed previous to final rounding. 
x*y Zz RN/RU/RZ RD 
+0 +0 || GO) + G0) =-0)) GO) eb) | 6=-0 
+0 -0 |) (0) +(+0) =+0) (0) +(+0) =-0 
0 +0 |) GO) +(-0) =+0) (+40) +(-0) =-0 
-0 -0 (+0) +(+0) =+0) (+0) +(+0) =+0 
Table 6.16: VFMADDN outcome when adding zeros depending on rounding-mode 
This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 
Reference Number: 327364-001 293 


(intel 
CHAPTER 6. INSTRUCTION DESCRIPTIONS 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad p32 (zmm3/m) 


I 


for (n = 0; n < 16; n++) f{ 
if(kifm] != 0) f 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = (-(zmm2[i+31:i] * tmpSrc3[i+31:i]) - zmm1[i+31:i]) 
} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S;35 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 
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Register Swizzle: S;3. 


MVEX.EH=0 

S2S1So || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512 _mm512_fnmsub_ps (_m512,_m512,__m512); 
—m512 _mm512_mask_fnmsub_ps (_m512,_mmask16,__m512,_m512); 
—m512 _mm512_mask3_fnmsub_ps (_m512,__m512,__m512,__mmask16); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 


in a non-canonical form. 
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#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VGATHERDPD - Gather Float64 Vector With Signed Dword Indices 


Opcode Instruction Description 

MVEX.512.66.0F38.W1 92 vgatherdpd zmm1 {k1}, Gather float64 vector Usga(mz;) into float64 

/r /vsib Urea(mrt) vector zmm1 using doubleword indices and k1 
as completion mask. 


Description 


A set of 8 memory locations pointed by base address BASE_ADDR and doubleword 
index vector V[N DEX with scale SCALE are converted to a float64 vector. The result 
is written into float64 vector zmm1. 


Note the special mask behavior as only a subset of the active elements of write mask k1 
are actually operated on (as denoted by function SELECT_SUBSET). There are only 
two guarantees about the function: (a) the destination mask is a subset of the source mask 
(identity is included), and (b) on a given invocation of the instruction, at least one element 
(the least significant enabled mask bit) will be selected from the source mask. 


Programmers should always enforce the execution of a gather/scatter instruction to be 
re-executed (via a loop) until the full completion of the sequence (i.e. all elements of the 
gather/scatter sequence have been loaded/stored and hence, the write-mask bits all are 
zero). 


Note that accessed element by will always access 64 bytes of memory. The memory region 
accessed by each element will always be between elemen_linear_address & (~0x3F) and 
(element_linear_address & (~0x3F)) + 63 boundaries. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Note also the special mask behavior as the corresponding bits in write mask k1 are reset 
with each destination element being updated according to the subset of write mask k1. 
This is useful to allow conditional re-trigger of the instruction until all the elements from 
a given write mask have been successfully loaded. 


The instruction will #GP fault if the destination vector zmm1 is the same as index vector 
VINDEX. 


Operation 


// instruction works over a subset of the write mask 
ktemp = SELECT_SUBSET(k1) 


// Use mv, as vector memory operand (VSIB) 
for (n = 0; n < 8; nt++) f{ 


if (ktemp[n] != 0) { 
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i = 64*n 
j = 32+*n 
// mu;,[n] = BASE_ADDR + SignExtend(VINDEX[j+31:j] * SCALE) 
pointer [63:0] = mv, [n] 
zmmi[i+63:i] = UpConvLoad ;¢4 (pointer) 
ki[n] = 0 
} 


+ 
k1[15:8] = 0 


SIMD Floating-Point Exceptions 


None. 


Memory Up-conversion: U ¢¢4 


S25S1Spo || Function: Usage disp8*N 
000 no conversion [rax] 8 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512d _mm512_i32logather_pd (_m512i, void const*, int); 
_—m512d _mm512_mask_i32logather_pd (_m512d,__mmask8, _m512i, void const’, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 


#NM 
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If a memory address referencing the SS segment is 

in a non-canonical form, and corresponding write-mask bit is not zero. 
If a memory address is in a non-canonical form, 

and corresponding write-mask bit is not zero. 

If a memory operand linear address is not aligned 

to element-wise data granularity dictated by the UpConv 

and corresponding write-mask bit is not zero. 

If the destination vector is the same as the index vector [see 


If a memory operand linear address produces a page fault 
and corresponding write-mask bit is not zero. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 

If using a 16 bit effective address. 

If ModRM.rm is different than 100b. 

If no write mask is provided or selected write-mask is k0. 
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VGATHERDPS - Gather Float32 Vector With Signed Dword Indices 


300 


Opcode Instruction Description 
MVEX.512.66.0F38.W0 92 vgatherdpszmm1 {k1}, Ur32(mu;) Gather float32 vector Ur32(mu;) into float32 
/r /vsib vector zmm1 using doubleword indices and k1 


as completion mask. 


Description 


A set of 16 memory locations pointed by base address BAS E_ADDR and doubleword 
index vector VIN DEX with scale SCALE are converted to a float32 vector. The result 
is written into float32 vector zmm1. 


Note the special mask behavior as only a subset of the active elements of write mask k1 
are actually operated on (as denoted by function SELECT_SUBSET). There are only 
two guarantees about the function: (a) the destination mask is a subset of the source mask 
(identity is included), and (b) on a given invocation of the instruction, at least one element 
(the least significant enabled mask bit) will be selected from the source mask. 


Programmers should always enforce the execution of a gather/scatter instruction to be 
re-executed (via a loop) until the full completion of the sequence (i.e. all elements of the 
gather/scatter sequence have been loaded/stored and hence, the write-mask bits all are 
zero). 


Note that accessed element by will always access 64 bytes of memory. The memory region 
accessed by each element will always be between elemen_linear_address & (~0x3F) and 
(element_linear_address & (~0x3F)) + 63 boundaries. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Note also the special mask behavior as the corresponding bits in write mask k1 are reset 
with each destination element being updated according to the subset of write mask k1. 
This is useful to allow conditional re-trigger of the instruction until all the elements from 
a given write mask have been successfully loaded. 


The instruction will #GP fault if the destination vector zmm1 is the same as index vector 
VINDEX. 


Operation 


// instruction works over a subset of the write mask 
ktemp = SELECT_SUBSET(k1) 


// Use mu, as vector memory operand (VSIB) 
for (n = 0; n < 16; n++) f{ 


if (ktemp[n] != 0) { 
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i = 32*n 

// mu;,[n] = BASE_ADDR + SignExtend(VINDEX[i+31:i] * SCALE) 
pointer [63:0] = mv; [n] 

zmmi[i+31:i] = UpConvLoad ;32 (pointer) 

kifn] = 0 


SIMD Floating-Point Exceptions 


Invalid. 


Memory Up-conversion: U3. 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 float16 to float32 [rax] {float16} 2 

100 uint8 to float32 [rax] {uint8} 1 

101 sint8 to float32 [rax] {sint8} 1 

110 uint16 to float32 [rax] {uint16} 2 

111 sint16 to float32 [rax] {sint16} 2 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_i32gather_ps (_m512i, void const*, int); 

—m512 _mm512_mask_i32gather_ps (_m512,__mmask16, __m512i, void const’, int); 

—m512 _mm512_i32extgather_ps (_m512i, void const*, MM_UPCONV_PS_ENUM, int, 
int); 

—m512 _mm512_mask_i32extgather_ps (_m512, _mmask16, _m512i, void const*, 
_MM_UPCONV_PS_ENUM, int, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 
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#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form, and corresponding write-mask bit is not zero. 
#GP(0) If a memory address is in a non-canonical form, 


and corresponding write-mask bit is not zero. 

If a memory operand linear address is not aligned 

to element-wise data granularity dictated by the UpConv 
and corresponding write-mask bit is not zero. 

If the destination vector is the same as the index vector [see 


#PF(fault-code) If a memory operand linear address produces a page fault 
and corresponding write-mask bit is not zero. 
#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If using a 16 bit effective address. 
If ModRM.rm is different than 100b. 
If no write mask is provided or selected write-mask is k0. 
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VGATHERPFODPS - Gather Prefetch Float32 Vector With Signed Dword 
Indices Into L1 


Opcode Instruction Description 
MVEX.512.66.0F38.W0 C6 vgatherpfOdps Ur32(mv;) {k1} Gather Prefetch float32 vector U32(mvu;), using 
/1 /vsib doubleword indices with TO hint, under write- 
mask. 
Description 


Aset of 16 float32 memory locations pointed by base address BAS E_ADDR and double- 
word index vector VI NDEX withscale SCALE are prefetched from memory to L1 level 
of cache. If any memory access causes any type of memory exception, the memory access 
will be considered as completed (destination mask updated) and the exception ignored. 


Note the special mask behavior as only a subset of the active elements of write mask k1 
are actually operated on (as denoted by function SELECT_SUBSET). There are only 
two guarantees about the function: (a) the destination mask is a subset of the source mask 
(identity is included), and (b) on a given invocation of the instruction, at least one element 
(the least significant enabled mask bit) will be selected from the source mask. 


Programmers should always enforce the execution of a gather/scatter instruction to be 
re-executed (via a loop) until the full completion of the sequence (i.e. all elements of the 
prefetch sequence have been prefetched and hence, the write-mask bits all are zero). 


Note that accessed element by will always access 64 bytes of memory. The memory region 
accessed by each element will always be between elemen_linear_address & (~0x3F) and 
(element_linear_address & (~0x3F)) + 63 boundaries. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Note also the special mask behavior as the corresponding bits in write mask k1 are reset 
with each destination element being updated according to the subset of write mask k1. 
This is useful to allow conditional re-trigger of the instruction until all the elements from 
a given write mask have been successfully loaded. 


Note that both gather and scatter prefetches set the access bit (A) in the related TLB page 
entry. Scatter prefetches (which prefetch data with RFO) do not set the dirty bit (D). 


Operation 


// instruction works over a subset of the write mask 
ktemp = SELECT_SUBSET(k1) 


exclusive = 0 
evicthintpre = MVEX.EH 
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// Use muy, as vector memory operand (VSIB) 
for (n = 0; n < 16; n++) f{ 
if (ktemp[n] != 0) { 
i = 32*n 
// mu;[n] = BASE_ADDR + SignExtend(VINDEX[i+31:i] * SCALE) 
pointer [63:0] = mv; [n] 
FetchLicacheLine(pointer, exclusive, evicthintpre) 
kif{n] = 0 


SIMD Floating-Point Exceptions 


None. 


Memory Up-conversion: U;3. 


525159 || Function: Usage disp8*N 
000 no conversion [rax] 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 float16 to float32 [rax] {float16} 2 

100 uint8 to float32 [rax] {uint8} 1 

101 sint8 to float32 [rax] {sint8} 1 

110 uint16 to float32 [rax] {uint16} 2 

111 sint16 to float32 [rax] {sint16} 2 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_prefetch_i32gather_ps (_m512i, void const’, int, int); 

void _mm512_mask_prefetch_i32gather_ps (_m512i, _mmask16, void const*, int, 
int); 

void _mm512_prefetch_i32extgather_ps (_m512i, void const*, 
_MM_UPCONV_PS_ENUM,, int, int); 

void _mm512_mask_prefetch_i32extgather_ps ( _m512i, _mmask16, void const*, 
_MM_UPCONV_PS_ENUM, int, int); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 

If using a 16 bit effective address. 

If ModRM.rm is different than 100b. 

If no write mask is provided or selected write-mask is k0. 
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VGATHERPFOHINTDPD - Gather Prefetch Float64 Vector Hint With Signed 
Dword Indices 


306 


Opcode Instruction Description 
MVEX.512.66.0F38.W1 C6  vgatherpfOhintdpd Uyea(mu;) Gather Prefetch float64 vector U64(mvz), using 
/0 /vsib {k1} doubleword indices with TO hint, under write- 
mask. 
Description 


The instruction specifies a set of 8 float64 memory locations pointed by base address 
BASE_ADDR and doubleword index vector VN DEX with scale SCALE as a perfor- 
mance hint that a real gather instruction with the same set of sources will be invoked. A 
programmer may execute this instruction before a real gather instruction to improve its 
performance. 


This instruction is a hint and may be speculative, and may be dropped or specify invalid 
addresses without causing problems or memory related faults. This instructions does not 
modify any kind of architectural state (including the write-mask). 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Operation 


// Use mu, as vector memory operand (VSIB) 
for (n = 0; n < 8; nt++) { 
if (kifm] != 0) ¢ 
i = 64*n 
j = 324n 
// mvu,[n] = BASE_ADDR + SignExtend(VINDEX[j+31:j] * SCALE) 
pointer [63:0] = mv; [n] 
HintPointer (pointer) 


SIMD Floating-Point Exceptions 


None. 
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Memory Up-conversion: U y¢4 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] 8 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Intel’ C/C++ Compiler Intrinsic Equivalent 


None 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 


#NM 
#UD 


Reference Number: 327364-001 


Instruction not available in these modes 


If CRO.TS[bit 3]=1. 

If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 

If using a 16 bit effective address. 

If ModRM.rm is different than 100b. 

If no write mask is provided or selected write-mask is k0. 
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VGATHERPFOHINTDPS - Gather Prefetch Float32 Vector Hint With Signed 
Dword Indices 


Opcode Instruction Description 
MVEX.512.66.0F38.W0O C6 vgatherpfOhintdps Uy32(mv;,) Gather Prefetch float32 vector Uy32(mvu;), using 
/0 /vsib {k1} doubleword indices with TO hint, under write- 
mask. 
Description 


The instruction specifies a set of 16 float32 memory locations pointed by base address 
BASE_ADDR and doubleword index vector V[ NDEX with scale SCALE as a perfor- 
mance hint that a real gather instruction with the same set of sources will be invoked. A 
programmer may execute this instruction before a real gather instruction to improve its 
performance. 


This instruction is a hint and may be speculative, and may be dropped or specify invalid 
addresses without causing problems or memory related faults. This instructions does not 
modify any kind of architectural state (including the write-mask). 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Operation 


// Use mu, as vector memory operand (VSIB) 
for (n = 0; n < 16; n++) f{ 
if (kiln] !=0) f 
i = 32*n 
// mu,[n] = BASE_ADDR + SignExtend(VINDEX[i+31:i] * SCALE) 
pointer [63:0] = mv; [n] 
HintPointer (pointer) 
} 
} 


SIMD Floating-Point Exceptions 


None. 
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Memory Up-conversion: U;3. 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 float16 to float32 [rax] {float16} 2 

100 uint8 to float32 [rax] {uint8} 1 

101 sint8 to float32 [rax] {sint8} 1 

110 uint16 to float32 [rax] {uint16} 2 

111 sint16 to float32 [rax] {sint16} 2 


Intel’ C/C++ Compiler Intrinsic Equivalent 


None 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 


#NM 
#UD 


Reference Number: 327364-001 


Instruction not available in these modes 


If CRO.TS[bit 3]=1. 


If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 

If using a 16 bit effective address. 

If ModRM.rm is different than 100b. 
If no write mask is provided or selected write-mask is k0. 
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VGATHERPF1DPS - Gather Prefetch Float32 Vector With Signed Dword 
Indices Into L2 
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Opcode Instruction Description 
MVEX.512.66.0F38.W0 C6 vgatherpfidps Uy32(mvu;) {k1} Gather Prefetch float32 vector U32(mvuz), using 
/2 /vsib doubleword indices with T1 hint, under write- 
mask. 
Description 


Aset of 16 float32 memory locations pointed by base address BAS E_ADDR and double- 
word index vector VI NDEX withscale SCALE are prefetched from memory to L2 level 
of cache. If any memory access causes any type of memory exception, the memory access 
will be considered as completed (destination mask updated) and the exception ignored. 


Note the special mask behavior as only a subset of the active elements of write mask k1 
are actually operated on (as denoted by function SELECT_SUBSET). There are only 
two guarantees about the function: (a) the destination mask is a subset of the source mask 
(identity is included), and (b) on a given invocation of the instruction, at least one element 
(the least significant enabled mask bit) will be selected from the source mask. 


Programmers should always enforce the execution of a gather/scatter instruction to be 
re-executed (via a loop) until the full completion of the sequence (i.e. all elements of the 
prefetch sequence have been prefetched and hence, the write-mask bits all are zero). 


Note that accessed element by will always access 64 bytes of memory. The memory region 
accessed by each element will always be between elemen_linear_address & (~0x3F) and 
(element_linear_address & (~0x3F)) + 63 boundaries. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Note also the special mask behavior as the corresponding bits in write mask k1 are reset 
with each destination element being updated according to the subset of write mask k1. 
This is useful to allow conditional re-trigger of the instruction until all the elements from 
a given write mask have been successfully loaded. 


Note that both gather and scatter prefetches set the access bit (A) in the related TLB page 
entry. Scatter prefetches (which prefetch data with RFO) do not set the dirty bit (D). 


Operation 


// instruction works over a subset of the write mask 
ktemp = SELECT_SUBSET(k1) 


exclusive = 0 
evicthintpre = MVEX.EH 
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// Use muy, as vector memory operand (VSIB) 
for (n = 0; n < 16; n++) f{ 
if (ktemp[n] != 0) { 
i = 32*n 
// mu;,[n] = BASE_ADDR + SignExtend(VINDEX[i+31:i] * SCALE) 
pointer [63:0] = mv; [n] 
FetchL2cacheLine(pointer, exclusive, evicthintpre) 
kif] = 0 


SIMD Floating-Point Exceptions 


None. 


Memory Up-conversion: U3. 


525159 || Function: Usage disp8*N 
000 no conversion [rax] 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 float16 to float32 [rax] {float16} 2 

100 uint8 to float32 [rax] {uint8} 1 

101 sint8 to float32 [rax] {sint8} 1 

110 uint16 to float32 [rax] {uint16} 2 

111 sint16 to float32 [rax] {sint16} 2 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_prefetch_i32gather_ps (_m512i, void const’, int, int); 

void _mm512_mask_prefetch_i32gather_ps (_m512i, _mmask16, void const*, int, 
int); 

void _mm512_prefetch_i32extgather_ps (_m512i, void const*, 
_MM_UPCONV_PS_ENUM,, int, int); 

void _mm512_mask_prefetch_i32extgather_ps ( _m512i, _mmask16, void const*, 
_MM_UPCONV_PS_ENUM, int, int); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 

If using a 16 bit effective address. 

If ModRM.rm is different than 100b. 

If no write mask is provided or selected write-mask is k0. 
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VGETEXPPD - Extract Float64 Vector of Exponents from Float64 Vector 


Opcode Instruction Description 

MVEX.512.66.0F38.W1 42 vgetexppd zmm1 {k1}, _ Extract float64 vector of exponents from vector 

/r S'rga(zmm2/m) S'rga(zmm2/m,) and store the result in zmm1, 
under write-mask. 


Description 


Performs an element-by-element exponent extraction from the Float64 vector result of 
the swizzle/broadcast/conversion process on memory or Float64 vector zmmz2. The re- 
sult is written into Float64 vector zmm1. 


GetExp() returns the (un-biased) exponent n in floating-point format. That is, when X = 
1/16, GetExp() returns the value —4, represented as C0800000 in IEEE single precision 
(for the single-precision version of the instruction). If the source is denormal, VGETEXP 
will normalize it prior to exponent extraction (unless DAZ=1). 


GetExp() function follows Table 6.17 when dealing with floating-point special number. 


Input | Result 
NaN _ | quietized input NaN 


+00 +00 
+0 —oo 
-0 —oo 
—oo +00 


Table 6.17: GetExp() special floating-point values behavior 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpSrc2[511:0] = zmm2[511:0] 

} else { 
tmpSrc2[511:0] = SwizzUpConvLoad fe4 (zmm2/m;) 

} 


for (n = 0; n < 8; nt++) f{ 
if(kifm] != 0) f{ 
i = 64*n 
zmm1[i+63:i] = GetExp(tmpSrc2[i+63:i]) 


Reference Number: 327364-001 


313 


> 
D 


CHAPTER 6. INSTRUCTION DESCRIPTIONS 


i 
} 


SIMD Floating-Point Exceptions 


Invalid, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
Not Applicable 


Memory Up-conversion: S ;¢4 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Register Swizzle: S ¢¢4 


MVEX.EH=0 

S5S1Spo || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

1xx SAE (Supress-All-Exceptions) , {sae} 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512d _mm512_getexp_pd (_m512d); 
_—m512d _mm512_mask_getexp_pd (_m512d,_mmask8,_m512d); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VGETEXPPS - Extract Float32 Vector of Exponents from Float32 Vector 


Opcode Instruction Description 

MVEX.512.66.0F38.W0 42 vgetexpps zmm1 {k1}, Extract float32 vector of exponents from vector 

/r S'p32(zmm2/m_) S'732(zmm2/m,) and store the result in zmm1, 
under write-mask. 


Description 


Performs an element-by-element exponent extraction from the Float32 vector result of 
the swizzle/broadcast/conversion process on memory or Float32 vector zmmz2. The re- 
sult is written into Float32 vector zmm1. 


GetExp() returns the (un-biased) exponent n in floating-point format. That is, when X = 
1/16, GetExp() returns the value —4, represented as C0800000 in IEEE single precision 
(for the single-precision version of the instruction). If the source is denormal, VGETEXP 
will normalize it prior to exponent extraction (unless DAZ=1). 


GetExp() function follows Table 6.18 when dealing with floating-point special number. 


Input | Result 
NaN _ | quietized input NaN 


+00 +00 
+0 —oo 
-0 —oo 
—oo +00 


Table 6.18: GetExp() special floating-point values behavior 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpSrc2[511:0] = zmm2[511:0] 

} else { 
tmpSrc2[511:0] = SwizzUpConvLoad p32 (zmm2/m;) 

} 


for (n = 0; n < 16; n++) f{ 
if(ki[m] != 0) f{ 
i = 32*n 
zmm1[i+31:i] = GetExp(tmpSrc2[it+31:i]) 
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SIMD Floating-Point Exceptions 


Invalid, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
Not Applicable 


Memory Up-conversion: S35 


525159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 


Register Swizzle: S;3. 


MVEX.EH=0 
S5S1Spo || Function: 4 x 32 bits Usage 
000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 
5251509 || Rounding Mode Override Usage 
1xx SAE (Supress-All-Exceptions) , {sae} 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


_m512 _mm512_getexp_ps (_m512); 
_—m512 _mm512_mask_getexp_ps (_m512,_mmask16,__m512); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VGETMANTPD - Extract Float64 Vector of Normalized Mantissas from 
Float64 Vector 


Opcode Instruction Description 
MVEX.512.66.0F3A.W1 26 vgetmantpd zmm1 {k1}, Get Normalized Mantissa from float64 vector 
/rib Syga(zmm2/m,), imm8 S'rga(zmm2/m,) and store the result in zmm1, 


using 77mm8 for sign control and mantissa inter- 
val normalization, under write-mask. 


Description 


Performs an element-by-element conversion of the Float64 vector result of the swiz- 
zle/broadcast/conversion process on memory or Float64 vector zmm2 to Float64 values 
with the mantissa normalized to the interval specified by interv and sign dictated by the 
sign control parameter sc. The result is written into Float64 vector zmm1. Denormal val- 
ues are explicitly normalized. 


The formula for the operation is: 


Get Mant(x) = +2*|x.signi ficand| 
where: 
1 <= |x. signi ficand| < 2 


Exponent k is dependent on the interval range defined by interv and whether the expo- 
nent of the source is even or odd. The sign of the final result is determined by sc and the 
source sign. 


GetMant() function follows Table 6.19 when dealing with floating-point special numbers. 


Input | Result Exceptions/comments 

NaN | QNaN(SRC) Raises #1 if sNaN 

+00 +00 ignore interv 

+0 +0.0 ignore interv 

-0 (SC[0])? +0.0 : —0.0 | ignore interv, set NaN/raise #1 if SC[1]=1 
—oo (SC[0])? +00 : —oo ignore interv, set NaN/raise #1 if SC[1]=1 
<0 set NaN/raise #1 if SC[1]=1 


Table 6.19: GetMant() special floating-point values behavior 
This instruction is write-masked, so only those elements with the corresponding bit set 


in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 
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Immediate Format 


Normalization Interval I, Ip 
[1,2) 0 0 
[1/2,2) 0 1 
[1/2,1) 1 0 
[3/4,3/2) 1 1 
Sign Control Iz Ip 
sign = sign(SRC) 0 

sign = 0 0 1 
DEST = NaN (#J) ifsign(SRC) =1 | 1 


Operation 


GetNormalizedMantissa(SRC , SignCtrl, Interv) 
1 
// Extracting the SRC sign, exponent and mantissa fields 
SIGN = (SignCtr1[0])? 0 : SRC[63]; 
EXP = SRC[63:52]; 
FRACT = (DAZ && (EXP == 0))? O : SRC[51:0]; 


// Check for NaN operand 
if(IsNaN(SRC)) { 
if (IsSNaN(SRC)) *set I flag* 
return QNaN (SRC) 
} 


// Tf SignCtr1[1] is set to 1, return NaN and set 

// exception flag if the operand is negative. 

// Note that -0.0 is included 

if( SignCtr1[1] && (SRC[63] == 1) ) { 
*set I flag* 
return QNaN_Indefinite 


} 


// Check for +/-INF and +/-0 
if( ( EXP == Ox7FF && FRACTION == 0 ) 
|| ( EXP == 0 && FRACTION == 0) ) { 
DEST[63:0] = (SIGN << 63) | (EXP[11:0] << 52) | FRACT[51:0]; 
return DEST 
} 


// Normalize denormal operands 

// note that denormal operands are treated as zero if 

// DAZ is set to 1 

if((EXP == 0) && (FRACTION !=0) { 
// JBIT is the hidden integral bit 
JBIT = 0; // Zero in case of denormal operands 
EXP = O3FFh; // Set exponent to BIAS 
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While(JBIT == 0) { 


JBIT = FRACT[51]; // Obtain fraction MSB 
FRACT = FRACT << 1; // Normalize mantissa 
EXP--; // and adjust exponent 


, 
*set D flag* 


} 


// Apply normalization intervals 
UNBIASED_EXP = EXP - O3FFh; // get exponent in 
IS_ODD_EXP = UNBIASED _EXP[O]; // if the unbiased 


if( (Interv == 10b) 
|| ( (Interv == 01b) && IS_ODD_EXP) 
|| (© (Interv == 11b) && (FRACT[51]==1)) ) { 


EXP = 0O3FEh; // Set exponent to 
} 
else { 

EXP = 03FFh; // Set exponent to 
} 


// form the final destination 


unbiased form 
exponent odd? 


-1 (unbiased) 


0 (unbiased) 


DEST[63:0] = (SIGN << 63) | (EXP[11:0] << 52) | FRACT[51:0]; 


return DEST 


sc = IMM8[3:2] 
interv = IMM8[1:0] 


if(source is a register operand and MVEX.EH bit is 1) { 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpSrc2[511:0] = zmm2[511:0] 

} else { 
tmpSrc2[511:0] = SwizzUpConvLoad rg, (zmm2/m,) 

} 


for (n = 0; n < 8; nt++) { 
if(kifm] != 0) { 
i = 64*n 
// float64 operation 


zmm1[i+63:i] = GetNormalizedMantissa(tmpSrc2[i+63:i], 


} 
} 
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SIMD Floating-Point Exceptions 


Invalid, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 


(MXCSR.DAZ)? 


YES : NO 


Flush Tiny Results To Zero : 
Not Applicable 


Memory Up-conversion: S 64 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Register Swizzle: S564 


MVEX.EH=0 

S55S1Spo || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

1xx SAE (Supress-All-Exceptions) , {sae} 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


_m512d _mm512_getmant_pd (_m512d, _MM_MANTISSA_NORM_ENUM, 


_MM_MANTISSA_SIGN_ENUM); 


_—m512d _mm512_mask_getmant_pd (_m512d, —_mmaské8, _m512d, 


_MM_MANTISSA_NORM_ENUM, _MM_MANTISSA_SIGN_ENUM); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VGETMANTPS - Extract Float32 Vector of Normalized Mantissas from 
Float32 Vector 
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Opcode Instruction Description 
MVEX.512.66.0F3A.W0O 26 vgetmantps zmm1 {k1}, Get Normalized Mantissa from float32 vector 
/rib S'p32(zmm2/m;), imms S'f32(zmm2/m,) and store the result in zmm1, 
using 7mmé8 for sign control and mantissa inter- 
val normalization, under write-mask. 
Description 


Performs an element-by-element conversion of the Float32 vector result of the swiz- 
zle/broadcast/conversion process on memory or Float32 vector zmm2 to Float32 values 
with the mantissa normalized to the interval specified by interv and sign dictated by the 
sign control parameter sc. The result is written into Float32 vector zmm1. Denormal val- 
ues are explicitly normalized. 


The formula for the operation is: 


Get Mant(z) 


where: 


L2* |x. signi ficand| 


1 <= |x. signi ficand| < 2 


Exponent k is dependent on the interval range defined by interv and whether the expo- 
nent of the source is even or odd. The sign of the final result is determined by sc and the 


source sign. 


GetMant() function follows Table 6.20 when dealing with floating-point special numbers. 


Input | Result Exceptions/comments 

NaN | QNaN(SRC) Raises #1 if sNaN 

+00 +00 ignore interv 

+0 +0.0 ignore interv 

-0 (SC[0])? +0.0 : —0.0 | ignore interv, set NaN/raise #1 if SC[1]=1 
—oo (SC[0])? +00 : —oo ignore interv, set NaN/raise #1 if SC[1]=1 
<0 set NaN/raise #1 if SC[1]=1 


Table 6.20: GetMant() special floating-point values behavior 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Reference Number: 327364-001 


= 
=r 
é 


CHAPTER 6. INSTRUCTION DESCRIPTIONS 


Immediate Format 


Operation 


Normalization Interval I, Ip 
[1,2) 0 0 
[1/2,2) 0 1 
[1/2,1) 1 0 
[3/4,3/2) 1 1 
Sign Control Iz Ip 
sign = sign(SRC) 0 

sign = 0 0 1 
DEST = NaN (#J) ifsign(SRC) =1 | 1 


GetNormalizedMantissa(SRC , SignCtrl, Interv) 


4 


// Extracting the SRC sign, exponent and mantissa fields 
SIGN = (SignCtr1[0])? 0 : SRC[31]; 


EXP = SRC[30: 
(DAZ && (EXP == 0))? 0 : SRC[22:0]; 


FRACT 


23] ; 


// Check for NaN operand 


if (IsNaN (SRC) ) 


{ 


if (IsSNaN(SRC)) *set I flag* 
return QNaN (SRC) 


} 


// Tf SignCtr1[1] is set to 1, return NaN and set 

// exception flag if the operand is negative. 

// Note that -0.0 is included 

if( SignCtr1[1] && (SRC[31] == 1) ) £ 


*set I flag* 
return QNaN_ 


} 


Indefinite 


// Check for +/-INF and +/-0 


if( ( EXP == OxFF && FRACTION == 0 ) 
|| ( EXP == 0 && FRACTION == 0) ) { 
DEST[31:0] = (SIGN << 31) | (EXP[7:0] << 23) | FRACT[22:0]; 


return DEST 
} 


// Apply normalization intervals 


UNBIASED_EXP = 
IS_ODD_EXP = 


if( (Interv == 


EXP - O7Fh; // get exponent in unbiased form 
UNBIASED_EXP[0] ; // if the unbiased exponent odd? 
10b) 


|| ( (Interv == 01b) && IS_ODD_EXP) 
|| © (Interv == 11b) && (FRACT[22]==1)) ) { 
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EXP = O7Eh; // Set exponent to -1 (unbiased) 
} 
else { 

EXP = 07Fh; // Set exponent to 0 (unbiased) 
} 


// form the final destination 
DEST[31:0] = (SIGN << 31) | (EXP[7:0] << 23) | FRACT[22:0]; 
return DEST 


sc = IMM8[3:2] 
interv = IMM8[1:0] 


if(source is a register operand and MVEX.EH bit is 1) { 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpSrc2[511:0] = zmm2[511:0] 

} else { 
tmpSrc2[511:0] = SwizzUpConvLoad 32 (zmm2/m,) 

} 


for (n = 0; n < 16; n++) f{ 
if(kifm] != 0) { 
i = 32*n 
// float32 operation 
zmmi[it+31:i] = GetNormalizedMantissa(tmpSrc2[i+31:i], sc, interv) 
} 
} 


SIMD Floating-Point Exceptions 


Invalid, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
Not Applicable 
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Memory Up-conversion: S;35 

S2515o || Function: Usage disp8*N 

000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 


Register Swizzle: S35 


MVEX.EH=0 
S55S1Spo || Function: 4 x 32 bits Usage 
000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 
525159 || Rounding Mode Override Usage 
1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512 


_—m512 


Exceptions 


_mm512_getmant_ps 
_MM_MANTISSA_SIGN_ENUM); 
_mm512_mask_getmant_ps 
_MM_MANTISSA_NORM_ENUM, _MM_MANTISSA_SIGN_ENUM); 


Real-Address Mode and Virtual-8086 


#UD 


(_m512, 


(_m512, 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


Instruction not available in these modes 
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64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


328 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VGMAXABSPS - Absolute Maximum of Float32 Vectors 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.WO vgmaxabsps zmm1 {k1}, zmm2, Determine the maximum of the absolute val- 
51/r S'f32(zmm3/mz) ues of float32 vector zmmz2 and float32 vector 


S'f32(zmm3/m,) and store the result in zmm1, 
under write-mask. 


Description 


Determines the maximum of the absolute values of each pair of corresponding elements 
in float32 vector zmm2 and the float32 vector result of the swizzle/broadcast/conversion 
process on memory or float32 vector zmm3. The result is written into float32 vector 
zmm1. 


Abs() returns the absolute value of one float32 argument. FpMax() returns the bigger 
of the two float32 arguments, following IEEE in general. NaN has special handling: If 
one source operand is NaN, then the other source operand is returned (choice made per- 
component). If both are NaN, then the unchanged NaN from the first source (here zmm2) 
is returned. Please note that if first source is a SNaN it won't be quietized, it will be re- 
turned without any modification. This differs from the new IEEE 754-08 rules, which 
states that in case of an input SNaN, its quietized version should be returned instead of 
the other value. 


Another new IEEE 754-08 rule is that max(-0,+0) == max(+0,-0) == +0, which honors the 
sign, in contrast to the comparison rules for signed zero (stated above). D3D10.0 recom- 
mends the IEEE 754-08 behavior here, but it will not be enforced; it is permissible for the 
result of comparing zeros to be dependent on the order of parameters, using a comparison 
that ignores the signs. 


This instruction treats input denormals as zeros according to the DAZ control bit, but it 
does not flush tiny results to zero. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


FpMaxAbs (A,B) 
{ 
if ((A == NaN) && (B == NaN)) 
return Abs(A); 
else if (A == NaN) 
return Abs(B); 
else if (B == NaN) 
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return Abs(A); 

else if ((Abs(A) == +inf) || (Abs(B) == +inf)) 
return tinf; 

else if (Abs(A) >= Abs(B)) 
return Abs(A); 

else 
return Abs(B); 

} 


if(source is a register operand and MVEX.EH bit is 1) { 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoad p32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
if(ki{m] != 0) f 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = FpMaxAbs(zmm2[i+31:i] , tmpSrc3[it+31:i]) 
} 
} 


SIMD Floating-Point Exceptions 


Invalid, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
NO 


Memory Up-conversion: S;35 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 
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Register Swizzle: S;3. 


MVEX.EH=0 

S255 || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512 _mm512_gmaxabs_ps (_m512,_m512); 
—m512 _mm512_mask_gmaxabs_p s(_m512,_mmask16,_m512,__m512); 


i 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VGMAXPD - Maximum of Float64 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.W1 vgmaxpd zmmi1 {ki}, zmm2, Determine the maximum of float64 vector 

53 /r Sea(zmm3/m+) zmm2z2 and float64 vector S'fg4(zmm3/m;,) and 
store the result in zmm1, under write-mask. 


Description 


Determines the maximum value of each pair of corresponding elements in float64 vec- 
tor zmm2 and the float64 vector result of the swizzle/broadcast/conversion process on 
memory or float64 vector zmm3. The result is written into float64 vector zmm1. 


FpMax() returns the bigger of the two float32 arguments, following IEEE in general. NaN 
has special handling: If one source operand is NaN, then the other source operand is re- 
turned (choice made per-component). If both are NaN, then the unchanged NaN from the 
first source (here zmm2) is returned. Please note that if first source is a SNaN it won't be 
quietized, it will be returned without any modification. This differs from the new IEEE 
754-08 rules, which states that in case of an input SNaN, its quietized version should be 
returned instead of the other value. 


Another new IEEE 754-08 rule is that max(-0,+0) == max(+0,-0) == +0, which honors the 
sign, in contrast to the comparison rules for signed zero (stated above). D3D10.0 recom- 
mends the IEEE 754-08 behavior here, but it will not be enforced; it is permissible for the 
result of comparing zeros to be dependent on the order of parameters, using a comparison 
that ignores the signs. 


This instruction treats input denormals as zeros according to the DAZ control bit, but it 
does not flush tiny results to zero. 


The following table describes exception flags priority: 


Input 1 Input 2 Flags Comments 

SNAN denormal #] #] priority over #D 
denormal SNAN #] #] priority over #D 

QNAN denormal | none QNaN rule priority over #D 
denormal QNAN none QNaNrule priority over #D 
normal denormal | #D__ onlyif DAZ=0 

denormal normal #D only if DAZ=0 

denormal denormal | #D __ only if DAZ=0 


Table 6.21: Max exception flags priority 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 
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Operation 

FpMax (A,B) 

{ 
if ((A == -0.0) && (B == +0.0)) return B; 
if ((A == +0.0) && (B == -0.0)) return A; 
if ((A == NaN) && (B == NaN)) return A; 
if (A == NaN) return B; 
if (B == NaN) return A; 
if (A == -inf) return B; 
if (B == -inf) return A; 
if (A == +inf) return A; 
if (B == +inf) return B; 
if (A >= B) return A; 
return B; 

} 


if(source is a register operand and MVEX.EH bit is 1) { 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoad fe4 (zmm3/m;) 

} 


for (n = 0; n < 8; nt+) { 
if Ged [ay 1.0) 4 
i = 64*n 
// float64 operation 
zmm1[i+63:i] = FpMax(zmm2[i+63:i] , tmpSrc3[it+63:i]) 
} 
} 


SIMD Floating-Point Exceptions 


Invalid, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
NO 
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Memory Up-conversion: S ;¢4 

S2515o || Function: Usage disp8*N 

000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 

100 reserved N/A N/A 

101 reserved N/A N/A 

110 reserved N/A N/A 

111 reserved N/A N/A 


Register Swizzle: S ¢¢4 


MVEX.EH=0 

S55S1Spo || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512d _mm512_gmax_pd (_m512d,__m512d); 
—m512d _mm512_mask_gmax_pd (_.m512d,__mmask8,_ 
Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 
#UD Instruction not available in these modes 
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64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 
mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VGMAXPS - Maximum of Float32 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.WO vgmaxps zmmi1 {k1}, zmm2, Determine the maximum of float32 vector 

53 /r S'p32(zmm3/mz) zmm2z2 and float32 vector S'r32(zmm3/m;,) and 
store the result in zmm1, under write-mask. 


Description 


Determines the maximum value of each pair of corresponding elements in float32 vec- 
tor zmm2 and the float32 vector result of the swizzle/broadcast/conversion process on 
memory or float32 vector zmm3. The result is written into float32 vector zmm1. 


FpMax() returns the bigger of the two float32 arguments, following IEEE in general. NaN 
has special handling: If one source operand is NaN, then the other source operand is re- 
turned (choice made per-component). If both are NaN, then the unchanged NaN from the 
first source (here zmm2) is returned. Please note that if first source is a SNaN it won't be 
quietized, it will be returned without any modification. This differs from the new IEEE 
754-08 rules, which states that in case of an input SNaN, its quietized version should be 
returned instead of the other value. 


Another new IEEE 754-08 rule is that max(-0,+0) == max(+0,-0) == +0, which honors the 
sign, in contrast to the comparison rules for signed zero (stated above). D3D10.0 recom- 
mends the IEEE 754-08 behavior here, but it will not be enforced; it is permissible for the 
result of comparing zeros to be dependent on the order of parameters, using a comparison 
that ignores the signs. 


This instruction treats input denormals as zeros according to the DAZ control bit, but it 
does not flush tiny results to zero. 


The following table describes exception flags priority: 


Input 1 Input 2 Flags Comments 

SNAN denormal #] #] priority over #D 
denormal SNAN #] #] priority over #D 

QNAN denormal | none QNaN rule priority over #D 
denormal QNAN none QNaNrule priority over #D 
normal denormal | #D__ onlyif DAZ=0 

denormal normal #D only if DAZ=0 

denormal denormal | #D__ only if DAZ=0 


Table 6.22: Max exception flags priority 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 
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Operation 

FpMax (A,B) 

{ 
if ((A == -0.0) && (B == +0.0)) return B; 
if ((A == +0.0) && (B == -0.0)) return A; 
if ((A == NaN) && (B == NaN)) return A; 
if (A == NaN) return B; 
if (B == NaN) return A; 
if (A == -inf) return B; 
if (B == -inf) return A; 
if (A == +inf) return A; 
if (B == +inf) return B; 
if (A >= B) return A; 
return B; 

} 


if(source is a register operand and MVEX.EH bit is 1) { 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoad p32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
a2 Gel [nj 1=.0) 4 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = FpMax(zmm2[it+31:i] , tmpSrc3[it+31:i]) 
} 
} 


SIMD Floating-Point Exceptions 


Invalid, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
NO 
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Memory Up-conversion: S;35 

S2515S9 || Function: Usage disp8*N 

000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 


Register Swizzle: S39 


MVEX.EH=0 

S25S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 
_—m512 


Exceptions 


_mm512_gmax_ps (_m512 
_mm512_mask_gmax_ps (_m512,__mmask16,__m512,__m512); 


Real-Address Mode and Virtual-8086 


#UD 


— 


m512); 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


Instruction not available in these modes 
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64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 
mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VGMINPD - Minimum of Float64 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.W1 vgminpd zmm1 {k1}, zmm2, Determine the minimum of float64 vector 

52 /r Sea(zmm3/mz) zmm2z2 and float64 vector S'rg4(zmm3/m;,) and 
store the result in zmm1, under write-mask. 


Description 


Determines the minimum value of each pair of corresponding elements in float64 vec- 
tor zmm2 and the float64 vector result of the swizzle/broadcast/conversion process on 
memory or float64 vector zmm3. The result is written into float64 vector zmm1. 


FpMin() returns the smaller of the two float32 arguments, following IEEE in general. NaN 
has special handling: If one source operand is NaN, then the other source operand is re- 
turned (choice made per-component). If both are NaN, then the unchanged NaN from the 
first source (here zmm2) is returned. Please note that if first source is a SNaN it won't be 
quietized, it will be returned without any modification. This differs from the new IEEE 
754-08 rules, which states that in case of an input SNaN, its quietized version should be 
returned instead of the other value. 


Another new IEEE 754-08 rule is that min(-0,+0) == min(+0,-0) == -0, which honors the 
sign, in contrast to the comparison rules for signed zero (stated above). D3D10.0 recom- 
mends the IEEE 754-08 behavior here, but it will not be enforced; it is permissible for the 
result of comparing zeros to be dependent on the order of parameters, using a comparison 
that ignores the signs. 


This instruction treats input denormals as zeros according to the DAZ control bit, but it 
does not flush tiny results to zero. 


The following table describes exception flags priority: 


Input 1 Input 2 Flags Comments 

SNAN denormal #] #] priority over #D 
denormal SNAN #] #] priority over #D 

QNAN denormal | none QNaN rule priority over #D 
denormal QNAN none QNaNrule priority over #D 
normal denormal | #D__ only if DAZ=0 

denormal normal #D only if DAZ=0 

denormal denormal | #D__ only if DAZ=0 


Table 6.23: Min exception flags priority 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 
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Operation 

FpMin(A,B) 

{ 
if ((A == -0.0) && (B == +0.0)) return A; 
if ((A == +0.0) && (B == -0.0)) return B; 
if ((A == NaN) && (B == NaN)) return A; 
if (A == NaN) return B; 
if (B == NaN) return A; 
if (A == -inf) return A; 
if (B == -inf) return B; 
if (A == +inf) return B; 
if (B == +inf) return A; 
if (A < B) return A; 
return B; 

} 


if(source is a register operand and MVEX.EH bit is 1) { 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoad fe4 (zmm3/m;) 

} 


for (n = 0; n < 8; nt+) { 
if Ged [ay 1.0) 4 
i = 64*n 
// float64 operation 
zmm1[i+63:i] = FpMin(zmm2[i+63:i] , tmpSrc3[i+63:i]) 
} 
} 


SIMD Floating-Point Exceptions 


Invalid, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
NO 
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Memory Up-conversion: S ;¢4 
S551Spo || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 
001 broadcast 1 element (x8) [rax] {1to8} 8 
010 broadcast 4 elements (x2) | [rax] {4to8} 32 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
Register Swizzle: S ¢¢4 

MVEX.EH=0 

525159 || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_m512d 
_—m512d 


Exceptions 


_mm512_gmin_pd (_m512d,_m512d); 
_mm512_mask_gmin_pd (_m512d,__mmask8,__m512d,_m512d); 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 
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64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 
mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VGMINPS - Minimum of Float32 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.WO vgminps zmm1 {k1}, zmm2, Determine the minimum of float32 vector 

52 /r S'p32(zmm3/mz) zmm2z2 and float32 vector S'r32(zmm3/m,) and 
store the result in zmm1, under write-mask. 


Description 


Determines the minimum value of each pair of corresponding elements in float32 vec- 
tor zmm2 and the float32 vector result of the swizzle/broadcast/conversion process on 
memory or float32 vector zmm3. The result is written into float32 vector zmm1. 


FpMin() returns the smaller of the two float32 arguments, following IEEE in general. NaN 
has special handling: If one source operand is NaN, then the other source operand is re- 
turned (choice made per-component). If both are NaN, then the unchanged NaN from the 
first source (here zmm2) is returned. Please note that if first source is a SNaN it won't be 
quietized, it will be returned without any modification. This differs from the new IEEE 
754-08 rules, which states that in case of an input SNaN, its quietized version should be 
returned instead of the other value. 


Another new IEEE 754-08 rule is that min(-0,+0) == min(+0,-0) == -0, which honors the 
sign, in contrast to the comparison rules for signed zero (stated above). D3D10.0 recom- 
mends the IEEE 754-08 behavior here, but it will not be enforced; it is permissible for the 
result of comparing zeros to be dependent on the order of parameters, using a comparison 
that ignores the signs. 


This instruction treats input denormals as zeros according to the DAZ control bit, but it 
does not flush tiny results to zero. 


The following table describes exception flags priority: 


Input 1 Input 2 Flags Comments 

SNAN denormal #] #] priority over #D 
denormal SNAN #] #] priority over #D 

QNAN denormal | none QNaN rule priority over #D 
denormal QNAN none QNaNrule priority over #D 
normal denormal | #D__ only if DAZ=0 

denormal normal #D only if DAZ=0 

denormal denormal | #D__ only if DAZ=0 


Table 6.24: Min exception flags priority 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 
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Operation 

FpMin(A,B) 

{ 
if ((A == -0.0) && (B == +0.0)) return A; 
if ((A == +0.0) && (B == -0.0)) return B; 
if ((A == NaN) && (B == NaN)) return A; 
if (A == NaN) return B; 
if (B == NaN) return A; 
if (A == -inf) return A; 
if (B == -inf) return B; 
if (A == +inf) return B; 
if (B == +inf) return A; 
if (A < B) return A; 
return B; 

} 


if(source is a register operand and MVEX.EH bit is 1) { 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoad p32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
if(ki[m] != 0) f{ 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = FpMin(zmm2[it+31:i] , tmpSrc3[it+31:i]) 
} 
} 


SIMD Floating-Point Exceptions 


Invalid, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
NO 
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Memory Up-conversion: S;35 

S2515S9 || Function: Usage disp8*N 

000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 


Register Swizzle: S39 


MVEX.EH=0 

S25S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 
_—m512 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


_mm512_gmin_ps(_m512,__m512); 
_mm512_mask_gmin_ps(__m512,__mmask16,_m512,__m512); 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


Instruction not available in these modes 
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64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 
mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VLOADUNPACKHD - Load Unaligned High And Unpack To Doubleword Vec- 


tor 


The high-64-byte portion of the byte/word/doubleword stream starting at the element- 
aligned address (m,—64) is loaded, converted and expanded into the write-mask-enabled 
elements of doubleword vector zmm1. The number of set bits in the write-mask deter- 
mines the length of the converted doubleword stream, as each converted doubleword is 
mapped to exactly one of the doubleword elements in zmm1, skipping over write-masked 
elements of zmm1. 


This instruction only transfers those converted doublewords (if any) in the stream that 
occur at or after the first 64-byte-aligned address following (m; — 64) (that is, in the high 
cache line of the memory stream for the current implementation). Elements in zmm1 
that don't map to those stream doublewords are left unchanged. The vloadunpackld in- 
struction is used to load the part of the stream before the first 64-byte-aligned address 
preceding m:. 


In conjunction with vloadunpackld, this instruction is useful for re-expanding data that 
was packed into a queue. Also in conjunction with vloadunpackld, it allows unaligned 
vector loads (that is, vector loads that are only element-wise, not vector-wise, aligned); 
use a mask of OxFFFF or no write-mask for this purpose. The typical instruction sequence 
to perform an unaligned vector load would be: 


// assume memory location is pointed by register rax 
vloadunpackld v0 {ki}, [rax] 
vloadunpackhd v0 {ki}, [rax+64] 


This instruction does not have broadcast support. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Note that this instruction will always access 64 bytes of memory. The memory region 
accessed will always be between linear_address & (~0x3F) and (linear_address & (~0x3F)) 
+ 63 boundaries. 


Note that the address reported by a page fault is the beggining of the 64-byte cache line 
boundary containing the memory operand. The instruction will not produce any #GP or 
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Opcode Instruction Description 
MVEX.512.0F38.W0 D4 /r = vioadunpackhd = zmmi1_ {k1}, Load high 64-byte-aligned portion of unaligned 
Uiz2(me) doubleword stream Uj32(m; - 64), unpack 
mask-enabled elements that fall in that portion, 
and store those elements in doubleword vector 
zmm1, under write-mask. 
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#SS fault due to address canonicity nor #PF fault if the address is aligned to a 64-byte 
boundary. Additionally, A/D bits in the page table will not be updated. 


This instruction is write-masked, so only those elements with the corresponding bit set in 
vector mask register k1 are modified in zmm1. Elements in zmm1 with the corresponding 
bit clear in vector mask1 retain their previous values. However, see above for unusual 
aspects of the write-mask's operation with this instruction. 


Operation 


loadOffset = 0 
upSize = UpConvLoadSize0fj32 (SSS [2:0]) 
foundNext64BytesBoundary = false 


pointer = m - 64 
for (n = 0; n < 16; n++) f{ 
if(ki[n] != 0) { 
if (foundNext64BytesBoundary == false) { 
if ( ( (Cpointer + (loadOffset+1)*upSize ) % 64) == 0 ) { 
foundNext64BytesBoundary = true 


} 
} else f{ 
i = 32*n 
zmm1[i+31:i] = UpConvLoadj32(pointer + upSize*loadOffset) 
} 
loadOffset++ 
} 
} 
Flags Affected 
None. 


Memory Up-conversion: U;35 


525159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 1 

101 sint8 to sint32 [rax] {sint8} 1 

110 uint16 to uint32 [rax] {uint16} 2 

111 sint16 to sint32 [rax] {sint16} 2 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_extloadunpackhi_epi32 (_m512i, void const*, 
_MM_UPCONV_EPI32_ENUM, int); 

_—m512i _mm512_mask_extloadunpackhi_epi32 (_m512i, _mmask16, void const*, 
_MM_UPCONV_EPI32_ENUM, int); 

—m512i _mm512_loadunpackhi_epi32 (_m512i, void const*); 

—m512i _mm512_mask_loadunpackhi_epi32 (_m512i,__mmask16, void const*); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 
#GP(0) 
#PF(fault-code) 


#NM 
#UD 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 

in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to element-wise data granularity dictated by the UpConv. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 

If the second operand is not a memory location. 
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VLOADUNPACKHPD - Load Unaligned High And Unpack To Float64 Vector 


352 


Opcode Instruction Description 
MVEX.512.0F38.W1D5 /r = vioadunpackhpd 9=zmmi1_ {k1}, Load high 64-byte-aligned portion of unaligned 
Urealme) float64 stream Uyga(m: - 64), unpack mask- 


enabled elements that fall in that portion, and 
store those elements in float64 vector zmm1, 
under write-mask. 


Description 


The high-64-byte portion of the quadword stream starting at the element-aligned address 
(m, — 64) is loaded, converted and expanded into the write-mask-enabled elements of 
quadword vector zmm1. The number of set bits in the write-mask determines the length 
of the converted quadword stream, as each converted quadword is mapped to exactly one 
of the quadword elements in zmm1, skipping over write-masked elements of zmm1. 


This instruction only transfers those converted quadwords (if any) in the stream that oc- 
cur at or after the first 64-byte-aligned address following (m, — 64) (that is, in the high 
cache line of the memory stream for the current implementation). Elements in zmm1 
that don't map to those stream quadwords are left unchanged. The vloadunpacklpd in- 
struction is used to load the part of the stream before the first 64-byte-aligned address 
preceding m,. 


In conjunction with vloadunpacklpd, this instruction is useful for re-expanding data that 
was packed into a queue. Also in conjunction with vloadunpacklpd, it allows unaligned 
vector loads (that is, vector loads that are only element-wise, not vector-wise, aligned); 
use a mask of OxFF or no write-mask for this purpose. The typical instruction sequence 
to perform an unaligned vector load would be: 


// assume memory location is pointed by register rax 
vloadunpacklpd v0 {ki}, [rax] 
vloadunpackhpd v0 {ki}, [rax+64] 


This instruction does not have broadcast support. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Note that this instruction will always access 64 bytes of memory. The memory region 
accessed will always be between linear_address & (~0x3F) and (linear_address & (~0x3F)) 
+ 63 boundaries. 


Note that the address reported by a page fault is the beggining of the 64-byte cache line 
boundary containing the memory operand. The instruction will not produce any #GP or 
#SS fault due to address canonicity nor #PF fault if the address is aligned to a 64-byte 
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boundary. Additionally, A/D bits in the page table will not be updated. 


This instruction is write-masked, so only those elements with the corresponding bit set in 
vector mask register k1 are modified in zmm1. Elements in zmm1 with the corresponding 
bit clear in vector mask1 retain their previous values. However, see above for unusual 
aspects of the write-mask's operation with this instruction. 


Operation 


loadOffset = 0 
upSize = UpConvLoadSizeOf rg4 (SSS [2:0] ) 
foundNext64BytesBoundary = false 


pointer = m, - 64 
for (n = 0; n < 8; nt++) f{ 
if(ki[n] != 0) { 
if (foundNext64BytesBoundary == false) { 
if ( ( (Cpointer + (loadOffset+1)*upSize ) % 64) == 0 ) { 
foundNext64BytesBoundary = true 
} 
} else { 
i = 64*n 
zmmi[i+63:i] = UpConvLoadyg4(pointer + upSize*load0ffset) 
} 
loadOffset++ 


SIMD Floating-Point Exceptions 


None. 


Memory Up-conversion: U ¢¢4 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 8 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512d _mm512_extloadunpackhi_pd (_m512d, void const*, MM_UPCONV_PD_ENUM, 
int); 

_—m512d _mm512_mask_extloadunpackhi_pd (_m512d, _mmask8, void _ const*, 
_MM_UPCONV_PD_ENUM, int); 

_—m512d _mm512_loadunpackhi_pd (_m512d, void const*); 

—m512d _mm512_mask_loadunpackhi_pd (_m512d,__mmask8, void const*); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to element-wise data granularity dictated by the UpConv. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If the second operand is not a memory location. 
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VLOADUNPACKHPS - Load Unaligned High And Unpack To Float32 Vector 


Opcode Instruction Description 
MVEX.512.0F38.W0 D5 /r = vioadunpackhps = zmm1_ {k1}, Load high 64-byte-aligned portion of unaligned 
Ur32(me) float32 stream Us32(m: - 64), unpack mask- 


enabled elements that fall in that portion, and 
store those elements in float32 vector zmm1, 
under write-mask. 


Description 


The high-64-byte portion of the byte/word/doubleword stream starting at the element- 
aligned address (m,—64) is loaded, converted and expanded into the write-mask-enabled 
elements of doubleword vector zmm1. The number of set bits in the write-mask deter- 
mines the length of the converted doubleword stream, as each converted doubleword is 
mapped to exactly one of the doubleword elements in zmm1, skipping over write-masked 
elements of zmm1. 


This instruction only transfers those converted doublewords (if any) in the stream that 
occur at or after the first 64-byte-aligned address following (m; — 64) (that is, in the high 
cache line of the memory stream for the current implementation). Elements in zmm1 
that don't map to those stream doublewords are left unchanged. The viloadunpacklps in- 
struction is used to load the part of the stream before the first 64-byte-aligned address 
preceding m. 


In conjunction with vloadunpacklps, this instruction is useful for re-expanding data that 
was packed into a queue. Also in conjunction with vloadunpacklps, it allows unaligned 
vector loads (that is, vector loads that are only element-wise, not vector-wise, aligned); 
use a mask of OxFFFF or no write-mask for this purpose. The typical instruction sequence 
to perform an unaligned vector load would be: 


// assume memory location is pointed by register rax 
vloadunpacklps v0 {ki}, [rax] 
vloadunpackhps v0 {k1}, [rax+64] 


This instruction does not have broadcast support. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Note that this instruction will always access 64 bytes of memory. The memory region 
accessed will always be between linear_address & (~0x3F) and (linear_address & (~0x3F)) 
+ 63 boundaries. 


Note that the address reported by a page fault is the beggining of the 64-byte cache line 
boundary containing the memory operand. The instruction will not produce any #GP or 
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#SS fault due to address canonicity nor #PF fault if the address is aligned to a 64-byte 
boundary. Additionally, A/D bits in the page table will not be updated. 


This instruction is write-masked, so only those elements with the corresponding bit set in 
vector mask register k1 are modified in zmm1. Elements in zmm1 with the corresponding 
bit clear in vector mask1 retain their previous values. However, see above for unusual 
aspects of the write-mask's operation with this instruction. 


Operation 


loadOffset = 0 
upSize = UpConvLoadSizeDf f32 (SSS [2:0] ) 
foundNext64BytesBoundary = false 


pointer = m, - 64 
for (n = 0; n < 16; n++) f{ 
if(ki[n] != 0) { 
if (foundNext64BytesBoundary == false) { 
if ( ( (Cpointer + (loadOffset+1)*upSize ) % 64) == 0 ) { 
foundNext64BytesBoundary = true 
} 
} else { 
i = 32*n 
zmmi[i+31:i] = UpConvLoad;3.(pointer + upSize*loadOffset) 
} 
loadOffset++ 


SIMD Floating-Point Exceptions 


Invalid. 


Memory Up-conversion: U3. 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 float16 to float32 [rax] {float16} 2 

100 uint8 to float32 [rax] {uint8} 1 

101 sint8 to float32 [rax] {sint8} 1 

110 uint16 to float32 [rax] {uint16} 2 

111 sint16 to float32 [rax] {sint16} 2 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_extloadunpackhi_ps (_.m512, void const*, _MM_UPCONV_PS_ENUM, 


int); 


—m512 _mm512_mask_extloadunpackhi_ps (_m512, _mmask16, void _ const*, 
_MM_UPCONV_PS_ENUM, int); 

—m512 _mm512_loadunpackhi_ps (_m512, void const*); 

—m512 _mm512_mask_loadunpackhi_ps (_m512,__mmask16, void const*); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 
#GP(0) 
#PF(fault-code) 


#NM 
#UD 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 

in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to element-wise data granularity dictated by the UpConv. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 

If the second operand is not a memory location. 


357 


(intel 
CHAPTER 6. INSTRUCTION DESCRIPTIONS 


VLOADUNPACKHQ - Load Unaligned High And Unpack To Int64 Vector 
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Opcode Instruction Description 
MVEX.512.0F38.W1 D4 /r = vioadunpackhq zmmi1_ {k1}, Load high 64-byte-aligned portion of unaligned 
Uiga(™me) int64 stream Ujeg4(m, - 64), unpack mask- 


enabled elements that fall in that portion, and 
store those elements in int64 vector zmm1, un- 
der write-mask. 


Description 


The high-64-byte portion of the quadword stream starting at the element-aligned address 
(m, — 64) is loaded, converted and expanded into the write-mask-enabled elements of 
quadword vector zmm1. The number of set bits in the write-mask determines the length 
of the converted quadword stream, as each converted quadword is mapped to exactly one 
of the quadword elements in zmm1, skipping over write-masked elements of zmm1. 


This instruction only transfers those converted quadwords (if any) in the stream that oc- 
cur at or after the first 64-byte-aligned address following (m, — 64) (that is, in the high 
cache line of the memory stream for the current implementation). Elements in zmm1 that 
don't map to those stream quadwords are left unchanged. The vloadunpacklq instruction 
is used to load the part of the stream before the first 64-byte-aligned address preceding 
Mt. 


In conjunction with vloadunpacklq, this instruction is useful for re-expanding data that 
was packed into a queue. Also in conjunction with vloadunpacklq, it allows unaligned 
vector loads (that is, vector loads that are only element-wise, not vector-wise, aligned); 
use a mask of OxFF or no write-mask for this purpose. The typical instruction sequence 
to perform an unaligned vector load would be: 


// assume memory location is pointed by register rax 
vloadunpacklq v0 {ki}, [rax] 
vloadunpackhq v0 {ki}, [rax+64] 


This instruction does not have broadcast support. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Note that this instruction will always access 64 bytes of memory. The memory region 
accessed will always be between linear_address & (~0x3F) and (linear_address & (~0x3F)) 
+ 63 boundaries. 


Note that the address reported by a page fault is the beggining of the 64-byte cache line 
boundary containing the memory operand. The instruction will not produce any #GP or 
#SS fault due to address canonicity nor #PF fault if the address is aligned to a 64-byte 
boundary. Additionally, A/D bits in the page table will not be updated. 
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This instruction is write-masked, so only those elements with the corresponding bit set in 
vector mask register k1 are modified in zmm1. Elements in zmm1 with the corresponding 
bit clear in vector mask1 retain their previous values. However, see above for unusual 
aspects of the write-mask's operation with this instruction. 


Operation 


loadOffset = 0 
upSize = UpConvLoadSize0f jg4 (SSS [2:0]) 
foundNext64BytesBoundary = false 


pointer = m - 64 
for (n = 0; n < 8; nt++) f{ 
if(kifm] != 0) f 
if (foundNext64BytesBoundary == false) { 
if ( ( (Cpointer + (loadOffset+1)*upSize ) % 64) == 0 ) { 
foundNext64BytesBoundary = true 


} 
} else { 
i = 64*n 
zmm1[i+63:i] = UpConvLoadjg4(pointer + upSize*load0ffset) 
Hs 
loadOffset++ 
} 
} 
Flags Affected 
None. 


Memory Up-conversion: Uj64 


525159 || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 8 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_extloadunpackhi_epi64 (_m512i, void const*, 
_MM_UPCONV_EPI64_ENUM, int); 
_—m512i _mm512_mask_extloadunpackhi_epi64 (_m512i, _mmask8, void const*, 


_MM_UPCONV_EPI64_ENUM, int); 
_—m512i _mm512_loadunpackhi_epi64 (_m512i, void const*); 
—m512i _mm512_mask_loadunpackhi_epi64 (_m512i,__mmask8, void const*); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to element-wise data granularity dictated by the UpConv. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If the second operand is not a memory location. 
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VLOADUNPACKLD - Load Unaligned Low And Unpack To Doubleword Vec- 


tor 


The low-64-byte portion of the byte/word/doubleword stream starting at the element- 
aligned address m;, is loaded, converted and expanded into the write-mask-enabled el- 
ements of doubleword vector zmm1. The number of set bits in the write-mask deter- 
mines the length of the converted doubleword stream, as each converted doubleword is 
mapped to exactly one of the doubleword elements in zmm1, skipping over write-masked 
elements of zmm1. 


This instruction only transfers those converted doublewords (if any) in the stream that 
occur before the first 64-byte-aligned address following m;, (thatis, in the low cache line of 
the memory stream in the current implementation). Elements in zmm1 that don't map to 
those converted stream doublewords are left unchanged. The vloadunpackhd instruction 
is used to load the part of the stream at or after the first 64-byte-aligned address preceding 
Mt. 


In conjunction with vloadunpackhd, this instruction is useful for re-expanding data that 
was packed into a queue. Also in conjunction with vloadunpackhd, it allows unaligned 
vector loads (that is, vector loads that are only element-wise, not vector-wise, aligned); 
use a mask of OxFFFF or no write-mask for this purpose. The typical instruction sequence 
to perform an unaligned vector load would be: 


// assume memory location is pointed by register rax 
vloadunpackld v0 {ki}, [rax] 
vloadunpackhd v0 {ki}, [rax+64] 


This instruction does not have broadcast support. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Note that this instruction will always access 64 bytes of memory. The memory region 
accessed will always be between linear_address & (~0x3F) and (linear_address & (~0x3F)) 
+ 63 boundaries. 


Note that the address reported by a page fault is the beggining of the 64-byte cache line 
boundary containing the memory operand. 
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Opcode Instruction Description 
MVEX.512.0F38.W0 DO /r = vioadunpackld = zmmt1 {k1}, Load low 64-byte-aligned portion of unaligned 
Uiz2(me) doubleword stream Uj32(m:), unpack mask- 
enabled elements that fall in that portion, and 
store those elements in doubleword vector 
zmm1, under write-mask. 
Description 
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This instruction is write-masked, so only those elements with the corresponding bit set in 
vector mask register k1 are modified in zmm1. Elements in zmm1 with the corresponding 
bit clear in vector mask1 retain their previous values. However, see above for unusual 
aspects of the write-mask's operation with this instruction. 


Operation 


loadOffset = 0 
upSize = UpConvLoadSizeDf j32 (SSS [2:0] ) 


for(n = 0 ;n < 16; nt++) f{ 
i = 32*n 
if (kifn] != 0) { 
zmmi[it+31:i] = UpConvLoadj32 (m;t+upSize*loadOffset) 
loadOffsett++ 
if ( ( Gm + upSize*loadOffset) % 64) == 0) { 
break 
} 
} 
} 


Flags Affected 


None. 


Memory Up-conversion: U;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 1 

101 sint8 to sint32 [rax] {sint8} 1 

110 uint16 to uint32 [rax] {uint16} 2 

111 sint16 to sint32 [rax] {sint16} 2 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_extloadunpacklo_epi32 (_m512i, void const*, 
_MM_UPCONV_EPI32_ENUM, int); 

_m512i _mm512_mask_extloadunpacklo_epi32 (_m512i, _mmask16, void const*, 
_MM_UPCONV_EPI32_ENUM, int); 

_m512i _mm512_loadunpacklo_epi32 (_m512i, void const*); 

_m512i _mm512_mask_loadunpacklo_epi32 (_m512i,__mmask16, void const*); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 
#GP(0) 
#PF(fault-code) 


#NM 
#UD 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 

in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to element-wise data granularity dictated by the UpConv. 
For a page fault. 

If CRO.TS[bit 3]=1. 


If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If the second operand is not a memory location. 
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VLOADUNPACKLPD - Load Unaligned Low And Unpack To Float64 Vector 
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Opcode Instruction Description 
MVEX.512.0F38.W1D1/r = vioadunpacklpd zmmi1_ {k1}, Load low 64-byte-aligned portion of unaligned 
Urealme) float64 stream U f¢4(m), unpack mask-enabled 


elements that fall in that portion, and store 
those elements in float64 vector zmm1, under 
write-mask. 


Description 


The low-64-byte portion of the quadword stream starting at the element-aligned address 
me is loaded, converted and expanded into the write-mask-enabled elements of quadword 
vector zmm1. The number of set bits in the write-mask determines the length of the con- 
verted quadword stream, as each converted quadword is mapped to exactly one of the 
quadword elements in zmm1, skipping over write-masked elements of zmm1. 


This instruction only transfers those converted quadwords (if any) in the stream that oc- 
cur before the first 64-byte-aligned address following m, (that is, in the low cache line of 
the memory stream in the current implementation). Elements in zmm1 that don't map to 
those converted stream quadwords are left unchanged. The vloadunpackhg instruction is 
used to load the part of the stream at or after the first 64-byte-aligned address preceding 
Mt. 


In conjunction with vloadunpackhpd, this instruction is useful for re-expanding data that 
was packed into a queue. Also in conjunction with vloadunpackhpd, it allows unaligned 
vector loads (that is, vector loads that are only element-wise, not vector-wise, aligned); 
use a mask of OxFF or no write-mask for this purpose. The typical instruction sequence 
to perform an unaligned vector load would be: 


// assume memory location is pointed by register rax 
vloadunpacklpd v0 {k1}, [rax] 
vloadunpackhpd v0 {ki}, [rax+64] 


This instruction does not have broadcast support. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Note that this instruction will always access 64 bytes of memory. The memory region 
accessed will always be between linear_address & (~0x3F) and (linear_address & (~0x3F)) 
+ 63 boundaries. 


Note that the address reported by a page fault is the beggining of the 64-byte cache line 
boundary containing the memory operand. 


This instruction is write-masked, so only those elements with the corresponding bit set in 
vector mask register k1 are modified in zmm1. Elements in zmm1 with the corresponding 
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bit clear in vector mask1 retain their previous values. However, see above for unusual 
aspects of the write-mask's operation with this instruction. 


Operation 


loadOffset 


=0 


upSize = UpConvLoadSize0f rg4 (SSS [2:0] ) 


for(n = 0 ;n < 8; n++) f{ 
i = 64*n 
if (kilm] != 0) f 
zmmi[i+63:i] = UpConvLoadrg4(m,+upSize*loadO0ffset) 
loadOffset++ 
if ( ( Gm + upSize*loadOffset) % 64) == 0) { 
break 


} 
} 
I 


SIMD Floating-Point Exceptions 


None. 


Memory Up-conversion: U ¢¢4 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 8 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_m512d 
_m512d 


_m512d 
_m512d 


_mm512_extloadunpacklo_pd (_m512d, void const*, MM_UPCONV_PD_ENUM, 
int); 

_mm512_mask_extloadunpacklo_pd (_m512d, _mmask8, void _ const*, 
_MM_UPCONV_PD_ENUM, int); 

_mm512_loadunpacklo_pd (__m512d, void const*); 
_mm512_mask_loadunpacklo_pd (__m512d, _mmaskg8, void const*); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to element-wise data granularity dictated by the UpConv. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If the second operand is not a memory location. 
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VLOADUNPACKLPS - Load Unaligned Low And Unpack To Float32 Vector 


Opcode Instruction Description 
MVEX.512.0F38.W0 D1 /r = vioadunpacklps zmm1_ {k1}, Load low 64-byte-aligned portion of unaligned 
Ur32(me) float32 stream U 32(m,), unpack mask-enabled 


elements that fall in that portion, and store 
those elements in float32 vector zmm1, under 
write-mask. 


Description 


The low-64-byte portion of the byte/word/doubleword stream starting at the element- 
aligned address m; is loaded, converted and expanded into the write-mask-enabled el- 
ements of doubleword vector zmm1. The number of set bits in the write-mask deter- 
mines the length of the converted doubleword stream, as each converted doubleword is 
mapped to exactly one of the doubleword elements in zmm1, skipping over write-masked 
elements of zmm1. 


This instruction only transfers those converted doublewords (if any) in the stream that 
occur before the first 64-byte-aligned address following m;, (thatis, in the low cache line of 
the memory stream in the current implementation). Elements in zmm1 that don't map to 
those converted stream doublewords are left unchanged. The vloadunpackhd instruction 
is used to load the part of the stream at or after the first 64-byte-aligned address preceding 
Mt. 


In conjunction with vloadunpackhps, this instruction is useful for re-expanding data that 
was packed into a queue. Also in conjunction with vloadunpackhps, it allows unaligned 
vector loads (that is, vector loads that are only element-wise, not vector-wise, aligned); 
use a mask of OxFFFF or no write-mask for this purpose. The typical instruction sequence 
to perform an unaligned vector load would be: 


// assume memory location is pointed by register rax 
vloadunpacklps v0 {k1}, [rax] 
vloadunpackhps v0 {k1}, [rax+64] 


This instruction does not have broadcast support. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Note that this instruction will always access 64 bytes of memory. The memory region 
accessed will always be between linear_address & (~0x3F) and (linear_address & (~0x3F)) 
+ 63 boundaries. 


Note that the address reported by a page fault is the beggining of the 64-byte cache line 
boundary containing the memory operand. 


This instruction is write-masked, so only those elements with the corresponding bit set in 
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vector mask register k1 are modified in zmm1. Elements in zmm1 with the corresponding 
bit clear in vector mask1 retain their previous values. However, see above for unusual 
aspects of the write-mask's operation with this instruction. 


Operation 


loadOffset = 0 
upSize = UpConvLoadSizeDf f32 (SSS [2:0] ) 


for(n = 0 ;n < 16; nt++) { 
i = 32*n 
if (kilm] != 0) { 
zmm1[i+31:i] = UpConvLoad 32 (m,+upSize*loadO0ffset) 
loadOffset++ 
if ( ( Gm + upSize*loadOffset) % 64) == 0) { 
break 
} 
} 
} 


SIMD Floating-Point Exceptions 


Invalid. 


Memory Up-conversion: U3. 


S2515p9 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 float16 to float32 [rax] {float16} 2 

100 uint8 to float32 [rax] {uint8} 1 

101 sint8 to float32 [rax] {sint8} 1 

110 uint16 to float32 [rax] {uint16} 2 

111 sint16 to float32 [rax] {sint16} 2 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_extloadunpacklo_ps (_m512, void const*, _MM_UPCONV_PS_ENUM, 
int); 

—m512 _mm512_mask_extloadunpacklo_ps (_m512, _mmask16, void _ const*, 
_MM_UPCONV_PS_ENUM, int); 

—m512 _mm512_loadunpacklo_ps (_m512, void const*); 

—m512 _mm512_mask_loadunpacklo_ps (_m512,__mmask16, void const*); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 
#GP(0) 
#PF(fault-code) 


#NM 
#UD 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 

in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to element-wise data granularity dictated by the UpConv. 
For a page fault. 

If CRO.TS[bit 3]=1. 


If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If the second operand is not a memory location. 
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VLOADUNPACKLQ - Load Unaligned Low And Unpack To Int64 Vector 
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Opcode Instruction Description 
MVEX.512.0F38.W1 D0 /r = vioadunpacklq) = zmmt1 {k1}, Load low 64-byte-aligned portion of unaligned 
Uiga(™me) int64 stream Ujg¢4(m,), unpack mask-enabled 


elements that fall in that portion, and store 
those elements in int64 vector zmm1, under 
write-mask. 


Description 


The low-64-byte portion of the quadword stream starting at the element-aligned address 
me is loaded, converted and expanded into the write-mask-enabled elements of quadword 
vector zmm1. The number of set bits in the write-mask determines the length of the con- 
verted quadword stream, as each converted quadword is mapped to exactly one of the 
quadword elements in zmm1, skipping over write-masked elements of zmm1. 


This instruction only transfers those converted quadwords (if any) in the stream that oc- 
cur before the first 64-byte-aligned address following m, (that is, in the low cache line of 
the memory stream in the current implementation). Elements in zmm1 that don't map to 
those converted stream quadwords are left unchanged. The vloadunpackhg instruction is 
used to load the part of the stream at or after the first 64-byte-aligned address preceding 
Tt. 


In conjunction with vloadunpackhg, this instruction is useful for re-expanding data that 
was packed into a queue. Also in conjunction with vloadunpackhg, it allows unaligned 
vector loads (that is, vector loads that are only element-wise, not vector-wise, aligned); 
use a mask of OxFF or no write-mask for this purpose. The typical instruction sequence 
to perform an unaligned vector load would be: 


// assume memory location is pointed by register rax 
vloadunpacklq v0 {ki}, [rax] 
vloadunpackhq v0 {ki}, [rax+64] 


This instruction does not have broadcast support. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Note that this instruction will always access 64 bytes of memory. The memory region 
accessed will always be between linear_address & (~0x3F) and (linear_address & (~0x3F)) 
+ 63 boundaries. 


Note that the address reported by a page fault is the beggining of the 64-byte cache line 
boundary containing the memory operand. 


This instruction is write-masked, so only those elements with the corresponding bit set in 
vector mask register k1 are modified in zmm1. Elements in zmm1 with the corresponding 
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bit clear in vector mask1 retain their previous values. However, see above for unusual 
aspects of the write-mask's operation with this instruction. 


Operation 


loadOffset = 0 
upSize = UpConvLoadSize0f jg4 (SSS [2:0]) 


for(n = 0 ;n < 8; n++) f{ 
i = 64*n 
if (kifm] !=0) f{ 
zmmi[i+63:i] = UpConvLoadjg4 (m;t+upSize*loadOffset) 
loadOffsett++ 
if ( ( Gm + upSize*loadOffset) % 64) == 0) { 
break 
} 
} 
} 


Flags Affected 


None. 


Memory Up-conversion: Uj64 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 8 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_extloadunpacklo_epi64 (_m512i, void const*, 
_MM_UPCONV_EPI64_ENUM, int); 
_m512i _mm512_mask_extloadunpacklo_epi64 (_m512i, _mmask8, void const*, 


_MM_UPCONV_EPI64_ENUM, int); 
_m512i _mm512_loadunpacklo_epi64 (_m512i, void const*); 
_m512i _mm512_mask_loadunpacklo_epi64 (_m512i,__mmask8, void const*); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to element-wise data granularity dictated by the UpConv. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If the second operand is not a memory location. 
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VLOG2PS - Vector Logarithm Base-2 of Float32 Vector 


Opcode Instruction Description 
MVEX.512.66.0F38.W0 C9 _ vilog2ps zmm1 {k1}, zmm2/m; Calculate logarithm from float32 vector 
/v zmm2/m, and store the result in zmm1, under 
write-mask. 
Description 


Computes the element-by-element logarithm base-2 of the float32 vector on memory or 
float32 vector zmm2. The result is written into float32 vector zmm1. 


1. 4ulp of relative error when the source value is within the intervals (0, 0.5) or (2, co] 
2. absolute error less than 2~! within the interval [0.5, 2] 


For an input value of +/ — 0 the instruction returns —co and sets the Divide-By-Zero 
flag (#Z). Negative numbers (including —oo) should return the canonical NaN and set the 
Invalid flag (#1). Note however that this instruction treats input denormals as zeros of 
the same sign, so for denormal negative inputs it returns —oo and sets the Divide-By-Zero 
status flag. If any source element is NaN, the quietized NaN source value is returned for 
that element (and #1 is raised for input sNaNs). 


Current implementation of this instruction does not support any SwizzUpConv setting 
other than "no broadcast and no conversion"; any other SwizzUpConv setting will result 
in an Invalid Opcode exception. 


log2_DX() function follows Table 6.25 when dealing with floating-point special numbers. 


Input | Result Comments 

NaN | input qNaN | Raise #I flag if sNaN 
+00 +00 

+0 —oo Raise #Z flag 

—0 —oo Raise #Z flag 

<0 NaN Raise #I flag 

—oo NaN Raise #I flag 

2" n Exact integral result 


Table 6.25: vlog2_DX() special floating-point values behavior 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 
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Operation 


tmpSrc2[511:0] = zmm2/m: 


if(source is a register operand and MVEX.EH bit is 1) { 


if (SSS[2]==1) Supress_Exception_Flags() // SAE 
} 
for (n = 0; n < 16; n++) f{ 
if (kifn] !=0) f 
i = 32*n 
zmm1[i+31:i] = vlog2_DX(tmpSrc2[i+31:i]) 
} 
} 
SIMD Floating-Point Exceptions 
Invalid, Zero. 
Denormal Handling 
Treat Input Denormals As Zeros : 
YES 
Flush Tiny Results To Zero : 
YES 
Register Swizzle 
MVEX.EH=0 
S5S1Spo || Function: 4 x 32 bits Usage 
000 no swizzle zmm0 or zmm0 {dcba} 
001 reserved N/A 
010 reserved N/A 
011 reserved N/A 
100 reserved N/A 
101 reserved N/A 
110 reserved N/A 
111 reserved N/A 
MVEX.EH=1 
525159 || Rounding Mode Override Usage 
1xx SAE (Supress-All-Exceptions) , {sae} 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_log2_ps (_m512); 
—m512 _mm512_mask_log2_ps (_m512,__mmask16,__m512); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 

This instruction does not support any 

SwizzUpConv different from the default value (no broadcast, 
no conversion). If SwizzUpConv function is set to any value 
different than "no action", then an Invalid Opcode fault is 
raised. This includes register swizzles. 
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VMOVAPD - Move Aligned Float64 Vector 


Opcode Instruction Description 

MVEX.512.66.0RW1 28 /r = vmovapd zmm1 {k1}, Usga(me) Move float64 vector Uyea(m:) into vector 
zmm1, under write-mask. 

MVEX.512.66.0FW1 28 /r =vmovapdzmm1 {k1}, Sg4(zmm2) Move float64 vector Sg4(zmm2) into vector 
zmm1, under write-mask. 

MVEX.512.66.0RW1 29 /r = vmovapd m; {k1}, Dyea(zmm1) Move float64 vector Dyg4(zmm1) into m;, un- 
der write-mask. 


Description 


Moves float64 vector result of the swizzle/broadcast/conversion process on memory or 
float64 vector zmmz2 into float64 vector zmm1 or down-converts and stores float64 vector 
zmmz2 into destination memory. 


This instruction is write-masked, so only those elements with the corresponding bit(s) set 
in the vector mask (k1) register are computed and stored into register/memory. Elements 
in register/memory with the corresponding bit(s) clear in the vector mask register are 
maintained with the previous value. 


Operation 


DESTINATION IS A VECTOR OPERAND 


if(source is a register operand) { 
if (MVEX.EH==1) { 
tmpSrc2[511:0] = zmm2[511:0] 
} else { 
tmpSrc2[511:0] = SwizzUpConvLoad r¢4 (zmm2) 
} 
} else { 
tmpSrc2[511:0] = UpConvLoad seq (mz) 


} 
for (n = 0; n < 8; n++) f{ 
if (kilm] != 0) { 
i = 64*n 
zmmi[i+63:i] = tmpSrc2[i+63:i]) 


} 
} 


DESTINATION IS AMEMORY OPERAND 
downSize = DownConvStoreSizeOf re4 (SSS [2:0] ) 
for(n = 0 ;n < 8; n++) { 
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if (kifm] != 0) { 
i = 64*n 
tmp = DownConvStore r¢g4(zmmi[it+63:i], SSS[2:0]) 
if (downSize == 8) { 
MemStore(m,+8*n) = tmp[63:0] 
} 


} 
} 


SIMD Floating-Point Exceptions 


DESTINATION IS A VECTOR OPERAND: None. 
DESTINATION IS A MEMORY OPERAND: None. 


Memory Up-conversion: U 64 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Register Swizzle: S;¢4 


MVEX.EH=0 

S25S1Spo || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 
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Memory Down-conversion: D ¢¢64 


S2515o || Function: Usage disp8*N 
000 no conversion zmm1 64 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_m512d 


Exceptions 


_mm512_mask_mov_pd (_m512d,_mmask8,__m512d); 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 


#SS(0) 


#GP(0) 


#PF(fault-code) 


#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 


in a non-canonical form. 


If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
For a page fault. 
If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VMOVAPS - Move Aligned Float32 Vector 


Opcode Instruction Description 

MVEX.512.0F.W0O 28 /r vmovaps zmm1 {k1}, Uf32(mz) Move float32 vector Uy32(m,) into vector 
zmm1, under write-mask. 

MVEX.512.0F.WO 28 /r vmovaps zmm1 {k1}, Si32(zmm2) Move float32 vector S32(zmm2) into vector 
zmm1, under write-mask. 

MVEX.512.0F.W0 29 /r vmovaps m, {k1}, D32(zmm1) Move float32 vector D32(zmm1) into m;, un- 
der write-mask. 

Description 


Moves float32 vector result of the swizzle/broadcast/conversion process on memory or 
float32 vector zmm2 into float32 vector zmm1 or down-converts and stores float32 vector 


zmmz2 into destination memory. 


This instruction is write-masked, so only those elements with the corresponding bit(s) set 
in the vector mask (k1) register are computed and stored into register/memory. Elements 
in register/memory with the corresponding bit(s) clear in the vector mask register are 


maintained with the previous value. 


Operation 


DESTINATION IS A VECTOR OPERAND 


if(source is a register operand) { 
if (MVEX.EH==1) { 
tmpSrc2[511:0] = zmm2[511:0] 
} else { 
tmpSrc2[511:0] = SwizzUpConvLoad y32 (zmm2) 
} 
} else { 
tmpSrc2[511:0] = UpConvLoad 32 (mz) 


} 
for (n = 0; n < 16; n++) { 
if (kilm] != 0) { 
i = 32*n 
zmm1[i+31:i] = tmpSrc2[i+31:i]) 


} 
} 


DESTINATION IS AMEMORY OPERAND 
downSize = DownConvStoreSizeOf 32 (SSS [2:0] ) 
for(n = 0 ;n < 16; nt++) { 
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if (kifm] != 0) { 


a. 


= 32*n 


tmp = DownConvStore 32 (zmmi[it+31:i], SSS[2:0]) 
if (downSize == 4) { 


I 


} 


SIMD Floating-Point Exceptions 


MemStore(m;+4*n) = 
else if (downSize 
MemStore(m,;+2*n) = 
else if (downSize 
MemStore(m;tn) = 


tmp [31:0] 
== 2) { 
tmp [15:0] 
== 1) { 
tmp [7:0] 


DESTINATION IS A VECTOR OPERAND: Invalid. 
DESTINATION IS A MEMORY OPERAND: Overflow, Underflow, Invalid, Precision, Denor- 


mal. 


Memory Up-conversion: U3. 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

101 sint8 to float32 [rax] {sint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 


Register Swizzle: S¢39 


MVEX.EH=0 

S2S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 
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Memory Down-conversion: D 32 


S25S1Spo || Function: Usage disp8*N 
000 no conversion zmm1 64 
001 reserved N/A N/A 
010 reserved N/A N/A 
011 float32 to float16 zmm1 {float16} 32 
100 float32 to uint8 zmm1 {uint8} 16 
101 float32 to sint8 zmm1 {sint8} 16 
110 float32 to uint16 zmm1 {uint16} 32 
111 float32 to sint16 zmm1 {sint16} 32 
Intel’ C/C++ Compiler Intrinsic Equivalent 
—m512 _mm512_mask_mov_ps (_m512,__mmask16,_m512); 
Exceptions 
Real-Address Mode and Virtual-8086 
#UD Instruction not available in these modes 
Protected and Compatibility Mode 
#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VMOVDQA32 - Move Aligned Int32 Vector 


MVEX.512.66.0R WO 7F /r 


{k1}, 


Opcode Instruction 

MVEX.512.66.0RW06F /r  vmovdqa32 zmmt1 {k1}, U;32(m:) 

MVEX.512.66.0F.W0 6F /r = vmovdqa32 zmm1 
S32(zmm2) 


vmovdgqa32 m; {k1}, Dj32(zmm1) 


Description 

Move int32 vector U;32(m,) into vector zmm1, 
under write-mask. 

Move int32 vector Sj;32(zmm2) into vector 
zmm1, under write-mask. 

Move int32 vector Dj32(zmm1) into m;, under 
write-mask. 


Description 


Moves int32 vector result of the swizzle/broadcast/conversion process on memory or 
int32 vector zmm2 into int32 vector zmm1 or down-converts and stores int32 vector 


zmmz2 into destination memory. 


This instruction is write-masked, so only those elements with the corresponding bit(s) set 
in the vector mask (k1) register are computed and stored into register/memory. Elements 
in register/memory with the corresponding bit(s) clear in the vector mask register are 


maintained with the previous value. 


Operation 
DESTINATION IS A VECTOR OPERAND 


if(source is a register operand) { 
if (MVEX.EH==1) { 
tmpSrc2[511:0] = zmm2[511:0] 


} else f{ 
tmpSrc2[511:0] = SwizzUpConvLoadj32 (zmm2) 
} 
} else f{ 
tmpSrc2[511:0] = UpConvLoadj32 (mz) 
} 
for (n = 0; n < 16; n++) f{ 
if (kifm] != 0) { 
i = 32*n 
zmm1[it+31:i] = tmpSrc2[i+31:i]) 
Li 


} 


DESTINATION IS A MEMORY OPERAND 


downSize = DownConvStoreSize0f j32 (SSS [2:0] ) 
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for(n = 0 ;n < 16; nt++) f{ 
if (ki[m] != 0) { 
i = 32*n 
tmp = DownConvStore;39(zmmi[it+31:i], SSS[2:0]) 
if (downSize == 4) { 
MemStore(m;,+4*n) = tmp[31:0] 
} else if(downSize == 2) { 
MemStore(m;+2*n) = tmp[15:0] 
} else if(downSize == 1) { 
MemStore(m;,+n) = tmp[7:0] 


Flags Affected 


DESTINATION IS A VECTOR OPERAND: None. 
DESTINATION IS A MEMORY OPERAND: None. 


Memory Up-conversion: U;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S2S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 
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Memory Down-conversion: D;32 


S2515o || Function: Usage disp8*N 
000 no conversion zmm1 64 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 uint32 to uint8 zmm1 {uint8} 16 

101 sint32 to sint8 zmm1 {sint8} 16 

110 uint32 to uint16 zmm1 {uint16} 32 

111 sint32 to sint16 zmm1 {sint16} 32 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
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#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


Instruction not available in these modes 


_mm512_mask_mov_epi32 (_m512i,__mmask16, _m512i); 


If a memory address referencing the SS segment is 


in a non-canonical form. 


If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
For a page fault. 
If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VMOVDQA64 - Move Aligned Int64 Vector 


Opcode Instruction 
MVEX.512.66.0RW16F/r vmovdqa64 zmmt1 {k1}, Uiga(mz) 


MVEX.512.66.0FW16F /r §vmovdqa64 zmm1 {k1}, 
Siea(zmm2) 
MVEX.512.66.0FW17F /r vmovdqa64 m; {k1}, Dig4(zmm1) 


Description 

Move int64 vector Ujg4(m,) into vector zmm1, 
under write-mask. 

Move int64 vector Sjg4(zmm2) into vector 
zmm1, under write-mask. 

Move int64 vector Djg4(zmm1) into m:, under 
write-mask. 


Description 


Moves int64 vector result of the swizzle/broadcast/conversion process on memory or 
int64 vector zmm2 into int64 vector zmm1 or down-converts and stores int64 vector 


zmmz2 into destination memory. 


This instruction is write-masked, so only those elements with the corresponding bit(s) set 
in the vector mask (k1) register are computed and stored into register/memory. Elements 
in register/memory with the corresponding bit(s) clear in the vector mask register are 


maintained with the previous value. 


Operation 
DESTINATION IS A VECTOR OPERAND 


if(source is a register operand) { 
if (MVEX.EH==1) { 
tmpSrc2[511:0] = zmm2[511:0] 
} else f{ 
tmpSrc2[511:0] = SwizzUpConvLoadjg4 (zmm2) 
} 
} else f{ 
tmpSrc2[511:0] = UpConvLoadj64 (mz) 
} 


for (n = 0; n < 8; nt+) { 
if (kifm] != 0) { 
i = 64*n 
zmm1[i+63:i] = tmpSrc2[i+63:i]) 
} 
} 


DESTINATION IS A MEMORY OPERAND 


downSize = DownConvStoreSize0f jg4 (SSS [2:0] ) 
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for(n = 0 ;n < 8; n++) f{ 
if (kil[m] != 0) { 
i = 64*n 
tmp = DownConvStorejg4(zmmi [it+63:i], SSS[2:0]) 
if (downSize == 8) { 
MemStore(m;+8*n) = tmp[63:0] 
} 
} 
} 


Flags Affected 


DESTINATION IS A VECTOR OPERAND: None. 
DESTINATION IS A MEMORY OPERAND: None. 


Memory Up-conversion: Uj¢4 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Register Swizzle: Si¢4 


MVEX.EH=0 

S2S1Spo || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 
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Memory Down-conversion: Dj¢4 


S2515o || Function: Usage disp8*N 
000 no conversion zmm1 64 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i 


Exceptions 


_mm512_mask_mov_epi64 (_m512i,__mmask8, _m512i); 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 


#SS(0) 


#GP(0) 


#PF(fault-code) 


#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 


in a non-canonical form. 


If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
For a page fault. 
If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VMOVNRAPD - Store Aligned Float64 Vector With No-Read Hint 


Opcode Instruction Description 

MVEX.512.F3.0F.W1.EHO vmovnrapd m {k1}, Dyeg4(zmm1) Store with No-Read hint float64 vector 

29 /r D y64(zmm1) into m, under write-mask. 
Description 


Stores float64 vector zmm1 (or a down-converted version of it) into destination memory 
with a No-Read hint for the case the whole vector is going to be written into memory. This 
instruction is intended to speed up the case of stores in streaming kernels where we want 
to avoid wasting memory bandwidth by being forced to read the original content of entire 
cache lines from memory when we overwrite their whole contents completely. 


In Intel® Xeon Phi” coprocessor, this instruction is able to optimize memory bandwidth 
in case ofa cache miss and avoid reading the original contents of the memory destination 
operand if the following conditions hold true: 


¢ The instruction does not use a write-mask (MVEX.aaa=000). 
¢ The instruction does not perform any kind of down-conversion (MVEX.SSS=000). 


Note that this instruction is encoded by forcing MVEX.EH bit to 0. The Eviction Hint does 
not have any effect on this instruction. 


The No-Read directive is intended as a performance hint and could be ignored by a given 
processor implementation. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are stored to memory. Elements in the destination memory 
vector with the corresponding bit clear in k1 register retain their previous value. 


Operation 
DESTINATION IS A MEMORY OPERAND 


downSize = DownConvStoreSizeOf re4 (SSS [2:0] ) 


for(n = 0 ;n < 8; n++) { 
if (kifm] != 0) { 
i = 64*n 
tmp = DownConvStore rg4(zmmi [it+63:i], SSS[2:0]) 
if(downSize == 8) { 
MemStore(m;+8*n) = tmp[63:0] 
} 
} 
} 
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SIMD Floating-Point Exceptions 


None. 


Memory Down-conversion: D ¢4 


S25159 || Function: Usage disp8*N 
000 no conversion zmm1 64 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_storenr_pd(void*,__m512d); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VMOVNRAPS - Store Aligned Float32 Vector With No-Read Hint 


Opcode Instruction Description 

MVEX.512.F2.0F.W0.EHO vmovnraps m {k1}, Df32(zmm1) Store with No-Read hint float32 vector 

29 /r D 32(zmm1) into m, under write-mask. 
Description 


Stores float32 vector zmm1 (or a down-converted version of it) into destination memory 
with a No-Read hint for the case the whole vector is going to be written into memory. This 
instruction is intended to speed up the case of stores in streaming kernels where we want 
to avoid wasting memory bandwidth by being forced to read the original content of entire 
cache lines from memory when we overwrite their whole contents completely. 


In Intel® Xeon Phi” coprocessor, this instruction is able to optimize memory bandwidth 
in case of a cache miss and avoid reading the original contents of the memory destination 
operand if the following conditions hold true: 


¢ The instruction does not use a write-mask (MVEX.aaa=000). 
¢ The instruction does not perform any kind of down-conversion (MVEX.SSS=000). 


Note that this instruction is encoded by forcing MVEX.EH bit to 0. The Eviction Hint does 
not have any effect on this instruction. 


The No-Read directive is intended as a performance hint and could be ignored by a given 
processor implementation. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are stored to memory. Elements in the destination memory 
vector with the corresponding bit clear in k1 register retain their previous value. 


Operation 
DESTINATION IS A MEMORY OPERAND 


downSize = DownConvStoreSizeDf p32 (SSS [2:0] ) 


for(n = 0 ;n < 16; nt++) f{ 
if (kilm] != 0) { 
i = 32*n 
tmp = DownConvStore 32 (zmm1[i+31:i], SSS[2:0]) 
if(downSize == 4) { 
MemStore(m,;t+4*n) = tmp[31:0] 
} else if(downSize == 2) { 
MemStore(m,;+2*n) = tmp[15:0] 
} else if(downSize == 1) { 
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MemStore(m:t+n) = tmp[7:0] 
} 
} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Memory Down-conversion: D ;35 


S2515o || Function: Usage disp8*N 
000 no conversion zmm1 64 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 float32 to float16 zmm1 {float16} 32 

100 float32 to uint8 zmm1 {uint8} 16 

101 float32 to sint8 zmm1 {sint8} 16 

110 float32 to uint16 zmm1 {uint16} 32 

111 float32 to sint16 zmm1 {sint16} 32 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_storenr_ps(void*, m512); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
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If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VMOVNRNGOAPD - Non-globally Ordered Store Aligned Float64 Vector 
With No-Read Hint 


Opcode Instruction Description 

MVEX.512.F3.0F.W1.EH1 vmovnrngoapd m {k1}, Non-ordered Store with No-Read hint float64 

29 /r D e64(zmm1) vector Dg4(zmm1) into m, under write-mask. 
Description 


Stores float64 vector zmm1 (or a down-converted version of it) into destination memory 
with a No-Read hint for the case the whole vector is going to be written into memory, 
using a weakly-ordered memory consistency model (i.e. stores performed with these in- 
struction are not globally ordered, and subsequent stores from the same thread can be 
observed before them). 


This instruction is intended to speed up the case of stores in streaming kernels where we 
want to avoid wasting memory bandwidth by being forced to read the original content of 
entire cache lines from memory when we overwrite their whole contents completely. This 
instruction takes advantage of the weakly-ordered memory consistency model to increase 
the throughput at which this type of write operations can be performed. Due to the same 
reason, a fencing operation should be used in conjunction with this instruction if multiple 
threads are reading/writing the memory operand location. Though CPUID can be used as 
the fencing operation, better options are "LOCK ADD [RSP],0" (a dummy atomic add) or 
XCHG (which combines a store and a fence). 


In the Intel® Xeon Phi” coprocessor, this instruction is able to optimize memory band- 
width in case of a cache miss and avoid reading the original contents of the memory des- 
tination operand if the following conditions hold true: 


¢ The instruction does not use a write-mask (MVEX.aaa=000). 
¢ The instruction does not perform any kind of down-conversion (MVEX.SSS=000). 


Note that this instruction is encoded by forcing MVEX.EH bit to 1. The Eviction Hint does 
not have any effect on this instruction. 


The No-Read directive is intended as a performance hint and could be ignored by a given 
processor implementation. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are stored to memory. Elements in the destination memory 
vector with the corresponding bit clear in k1 register retain their previous value. 
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Operation 
DESTINATION IS A MEMORY OPERAND 


downSize = DownConvStoreSize0f fg4 (SSS [2:0] ) 


for(n = 0 ;n < 8; n++) { 
if (ki[n] != 0) { 
i = 64*n 
tmp = DownConvStore r¢g4(zmm1 [i+63:i], SSS[2:0]) 
if(downSize == 8) { 
MemStore(m,;+8*n) = tmp[63:0] 
} 
} 
} 


SIMD Floating-Point Exceptions 


None. 


Memory Down-conversion: D ¢4 


S2515S9 || Function: Usage disp8*N 
000 no conversion zmm1 64 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_storenrngo_pd(void*, m512d); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 
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Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VMOVNRNGOAPS - Non-globally Ordered Store Aligned Float32 Vector 
With No-Read Hint 


Opcode Instruction Description 

MVEX.512.F2.0F.W0.EH1 vmovnrngoaps m {k1}, Non-ordered Store with No-Read hint float32 

29 /r D32(zmm1) vector D32(zmm1) into m, under write-mask. 
Description 


Stores float32 vector zmm1 (or a down-converted version of it) into destination memory 
with a No-Read hint for the case the whole vector is going to be written into memory, 
using a weakly-ordered memory consistency model (i.e. stores performed with these in- 
struction are not globally ordered, and subsequent stores from the same thread can be 
observed before them). 


This instruction is intended to speed up the case of stores in streaming kernels where we 
want to avoid wasting memory bandwidth by being forced to read the original content of 
entire cache lines from memory when we overwrite their whole contents completely. This 
instruction takes advantage of the weakly-ordered memory consistency model to increase 
the throughput at which this type of write operations can be performed. Due to the same 
reason, a fencing operation should be used in conjunction with this instruction if multiple 
threads are reading/writing the memory operand location. Though CPUID can be used as 
the fencing operation, better options are "LOCK ADD [RSP],0" (a dummy atomic add) or 
XCHG (which combines a store and a fence). 


In the Intel® Xeon Phi” coprocessor, this instruction is able to optimize memory band- 
width in case of a cache miss and avoid reading the original contents of the memory des- 
tination operand if the following conditions hold true: 


¢ The instruction does not use a write-mask (MVEX.aaa=000). 
¢ The instruction does not perform any kind of down-conversion (MVEX.SSS=000). 


Note that this instruction is encoded by forcing MVEX.EH bit to 1. The Eviction Hint does 
not have any effect on this instruction. 


The No-Read directive is intended as a performance hint and could be ignored by a given 
processor implementation. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are stored to memory. Elements in the destination memory 
vector with the corresponding bit clear in k1 register retain their previous value. 
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Operation 


DESTINATION IS A MEMORY OPERAND 


downSize = DownConvStoreSizeOf 32 (SSS [2:0] ) 


for(n = 0 ;n < 16; nt++) f{ 
if (kilm] != 0) { 
i = 32*n 
tmp = DownConvStore r32(zmm1[i+31:i], SSS[2:0]) 
if(downSize == 4) { 
MemStore(m,;+4*n) = tmp[31:0] 
} else if(downSize == 2) { 
MemStore(m,;+2*n) = tmp[15:0] 
} else if(downSize == 1) { 
MemStore(m:t+n) = tmp[7:0] 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Memory Down-conversion: D;35 


S25159 || Function: Usage disp8*N 
000 no conversion zmm1 64 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 float32 to float16 zmm1 {float16} 32 

100 float32 to uint8 zmm1 {uint8} 16 

101 float32 to sint8 zmm1 {sint8} 16 

110 float32 to uint16 zmm1 {uint16} 32 

111 float32 to sint16 zmm1 {sint16} 32 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_storenrngo_ps(void*, _m512); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VMULPD - Multiply Float64 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0FW1 vmulpd zmm1 = {k1}, zmm2, Multiply float64 vector zmm2 and float64 vec- 

59 /r Sea(zmm3/m+) tor Sg4(zmm3/m;) and store the result in 
zmm1, under write-mask. 


Description 


Performs an element-by-element multiplication between float64 vector zmm2 and the 
float64 vector result of the swizzle/broadcast/conversion process on memory or float64 
vector zmm3. The result is written into float64 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad fe4 (zmm3/m,) 


} 


for (n = 0; n < 8; nt++) f{ 
if(kifm] != 0) f 
i = 64*n 
// float64 operation 
zmm1[i+63:i] = zmm2[i+63:i] * tmpSrc3[it+63:i] 
} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 
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Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S 64 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Register Swizzle: S ¢¢4 


MVEX.EH=0 

S25S1Spo || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512d _mm512_mul_pd (_m512d,_m512d); 
_—m512d _mm512_mask_mul_pd (_m512d,_mmask8,_m512d,_m512d); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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Opcode Instruction Description 
MVEX.NDS.512.0F.W059/r vmulps zmm1 {ki}, zmm2, Multiply float32 vector zmm2 and float32 vec- 
S'p32(zmm3/mz) tor S32(zmm3/m;) and store the result in 
zmm1, under write-mask. 


Description 


Performs an element-by-element multiplication between float32 vector zmm2 and the 
float32 vector result of the swizzle/broadcast/conversion process on memory or float32 
vector zmm3. The result is written into float32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad p32 (zmm3/m) 


} 


for (n = 0; n < 16; n++) f{ 
if(kifm] != 0) f 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = zmm2[i+31:i] * tmpSrc3[it31:i] 
} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 
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Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 
001 broadcast 1 element (x16) | [rax] {1to16} 4 
010 broadcast 4 elements (x4) | [rax] {4to16} 16 
011 float16 to float32 [rax] {float16} 32 
100 uint8 to float32 [rax] {uint8} 16 
110 uint16 to float32 [rax] {uint16} 32 
111 sint16 to float32 [rax] {sint16} 32 
Register Swizzle: S 3. 

MVEX.EH=0 

S251Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_mul_ps (_m512,__m512); 
—m512 _mm512_mask_mul_ps (_m512,_mmask16,__m512,__m512); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPACKSTOREHD - Pack And Store Unaligned High From Int32 Vector 


Opcode Instruction Description 
MVEX.512.66.0F38.W0O D4 _ vpackstorehd me {k1}, Pack mask-enabled elements of int32 vector 
/v Di32(zmm1) zmm1 to form an unaligned int32 stream, 


down-convert it and logically map the stream 
starting at m, — 64, and store that portion 
of the stream that maps to the high 64-byte- 
aligned portion of the memory destination, un- 
der write-mask. 


Description 


Packs and down-converts the mask-enabled elements of int32 vector zmm1 into a byte/word/doubleword 
stream logically mapped starting at element-aligned address (m, — 64), and stores the 

high-64-byte elements of that stream (those elements of the stream that map at or after 

the first 64-byte-aligned address following (m, — 64), the high cache line in the current 
implementation). The length of the stream depends on the number of enabled masks, as 

elements disabled by the mask are not added to the stream. 


The vpackstoreld instruction is used to store the part of the stream before the first 64- 
byte-aligned address preceding m. 


The mask is not used as a write-mask for this instruction. Instead, the mask is used as an 
element selector, choosing which elements are added to the stream. The one similarity 
to a write-mask as used in the rest of this document is that the no-write-mask option 
(encoding 0) is available to select a mask of OxFFFF for this instruction. For that reason, 
the notation and encoding are the same as for a write-mask. 


In conjunction with vpackstoreld, this instruction is useful for packing data into a queue. 
Also in conjunction with vpackstoreld, it allows unaligned vector stores (that is, vector 
stores that are only element-wise , not vector-wise, aligned); just use a mask of OxFFFF or 
no write-mask for this purpose. The typical instruction sequence to perform an unaligned 
vector store would be: 


// assume memory location is pointed by register rax 
vpackstoreld [rax] {k1}, vo 
vpackstorehd [raxt+64] {ki}, vO 


This instruction does not have subset support. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element after down-conversion. 


Note that the address reported by a page fault is the beggining of the 64-byte cache line 
boundary containing the memory operand. The instruction will not produce any #GP or 
#SS fault due to address canonicity nor #PF fault if the address is aligned to a 64-byte 
boundary. Additionally, A/D bits in the page table will not be updated. 
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Operation 


storeO0ffse 


t=0 


downSize = DownConvStoreSize0fj39 (SSS [2:0]) 
foundNext64BytesBoundary = false 


pointer = 
for (n = 0 


mt - 64 
; n < 16; nt+) { 


if(kifm] != 0) f 
if (foundNext64BytesBoundary == false) { 
if ( ( (pointer + (storeOffset+1)*downSize) % 64) == 0) { 
foundNext64BytesBoundary = true 


} 
} el 
i 


se { 
= 32*n 


tmp = DownConvStorej32 (zmmi [it+31:i], SSS[2:0]) 


if (downSize == 4) { 


} 

} 

} 
} 


stor 


MemStore (pointer 
else if (downSize 
MemStore (pointer 
else if (downSize 
MemStore (pointer 


eOffset++ 


Flags Affected 


None. 


Memory Down-conversion: D;3. 


+ storeOffset*4) = tmp[31:0] 
== 2) { 

+ storeOffset*2) = tmp[15:0] 
== 1) { 

+ storeOffset) = tmp[7:0] 


S2515S9 || Function: Usage disp8*N 
000 no conversion zmm1 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 uint32 to uint8 zmm1 {uint8} 1 

101 sint32 to sint8 zmm1 {sint8} 1 

110 uint32 to uint16 zmm1 {uint16} 2 

111 sint32 to sint16 zmm1 {sint16} 2 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_extpackstorehi_epi32 (void*, _m512i, 
_MM_DOWNCONV_EPI32_ENUM, int); 
void _mm512_mask_extpackstorehi_epi32 (void*, —_mmask16, _m512i, 


_MM_DOWNCONV_EPI32_ENUM, int); 
void _mm512_packstorehi_epi32 (void*, _m512i); 


void _mm512_mask_packstorehi_epi32 (void*, _mmask16, _m512i); 
Exceptions 
Real-Address Mode and Virtual-8086 
#UD Instruction not available in these modes 
Protected and Compatibility Mode 
#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to element-wise data granularity dictated by the DownConv. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If the fist operand is not a memory location. 
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VPACKSTOREHPD - Pack And Store Unaligned High From Float64 Vector 
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Opcode Instruction Description 
MVEX.512.66.0F38.W1 D5  vpackstorehpd me {k1}, Pack mask-enabled elements of float64 vector 
/v D e64(zmm1) zmm1 to form an unaligned float64 stream, 


down-convert it and logically map the stream 
starting at m, — 64, and store that portion 
of the stream that maps to the high 64-byte- 
aligned portion of the memory destination, un- 
der write-mask. 


Description 


Packs and down-converts the mask-enabled elements of float64 vector zmm1 into a 
float64 stream logically mapped starting at element-aligned address (m,—64), and stores 
the high-64-byte elements of that stream (those elements of the stream that map at or af- 
ter the first 64-byte-aligned address following (m,— 64), the high cache line in the current 
implementation). The length of the stream depends on the number of enabled masks, as 
elements disabled by the mask are not added to the stream. 


The vpackstorelpd instruction is used to store the part of the stream before the first 64- 
byte-aligned address preceding m. 


The mask is not used as a write-mask for this instruction. Instead, the mask is used as an 
element selector, choosing which elements are added to the stream. The one similarity 
to a write-mask as used in the rest of this document is that the no-write-mask option 
(encoding 0) is available to select a mask of OxFF for this instruction. For that reason, the 
notation and encoding are the same as for a write-mask. 


In conjunction with vpackstorelpd, this instruction is useful for packing data into a queue. 
Also in conjunction with vpackstorelpd, it allows unaligned vector stores (that is, vector 
stores that are only element-wise , not vector-wise, aligned); just use a mask of OxFF or 
no write-mask for this purpose. The typical instruction sequence to perform an unaligned 
vector store would be: 


// assume memory location is pointed by register rax 
vpackstorelpd [rax] {k1}, vo 
vpackstorehpd [rax+64] {ki}, vO 


This instruction does not have subset support. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element after down-conversion. 


Note that the address reported by a page fault is the beggining of the 64-byte cache line 
boundary containing the memory operand. The instruction will not produce any #GP or 
#SS fault due to address canonicity nor #PF fault if the address is aligned to a 64-byte 
boundary. Additionally, A/D bits in the page table will not be updated. 
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Operation 


storeOffset = 0 
downSize = DownConvStoreSize(f f¢4(SSS[2:0]) 
foundNext64BytesBoundary = false 


pointer = m: - 64 
for (n = 0; n < 8; nt++) { 
if(ki[m] != 0) f{ 
if (foundNext64BytesBoundary == false) { 
if ( ( (pointer + (store0ffset+1)*downSize) % 64) == 0) { 
foundNext64BytesBoundary = true 


} 
} else f{ 
i = 64*n 


tmp = DownConvStore rg4(zmm1[i+63:i], SSS[2:0]) 
if(downSize == 8) { 
MemStore (pointer + storeOffset*8) = tmp[63:0] 
} 
} 


store0ffset++ 


SIMD Floating-Point Exceptions 


None. 


Memory Down-conversion: D ¢¢4 


S25159 || Function: Usage disp8*N 
000 no conversion zmm1 8 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_extpackstorehi_pd (void*,__m512d,_ MM_DOWNCONV_PD_ENUM, int); 

void _mm512_mask_extpackstorehi_pd (void*, _mmaské, _m512d, 
_MM_DOWNCONV_PD_ENUM, int); 

void _mm512_packstorehi_pd (void*,_ m512d); 

void _mm512_mask_packstorehi_pd (void*,__mmask8,__m512d); 


Vee 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to element-wise data granularity dictated by the DownConv. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If the fist operand is not a memory location. 
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VPACKSTOREHPS - Pack And Store Unaligned High From Float32 Vector 


Opcode Instruction Description 
MVEX.512.66.0F38.W0 D5 vpackstorehps me {k1}, Pack mask-enabled elements of float32 vector 
/v D 32(zmm1) zmm1 to form an unaligned float32 stream, 


down-convert it and logically map the stream 
starting at m, — 64, and store that portion 
of the stream that maps to the high 64-byte- 
aligned portion of the memory destination, un- 
der write-mask. 


Description 


Packs and down-converts the mask-enabled elements of float32 vector zmm1 into a 
byte/word/doubleword stream logically mapped starting at element-aligned address 
(m, — 64), and stores the high-64-byte elements of that stream (those elements of the 
stream that map at or after the first 64-byte-aligned address following (m,; — 64), the high 
cache line in the current implementation). The length of the stream depends on the num- 
ber of enabled masks, as elements disabled by the mask are not added to the stream. 


The vpackstorelps instruction is used to store the part of the stream before the first 64- 
byte-aligned address preceding m. 


The mask is not used as a write-mask for this instruction. Instead, the mask is used as an 
element selector, choosing which elements are added to the stream. The one similarity 
to a write-mask as used in the rest of this document is that the no-write-mask option 
(encoding 0) is available to select a mask of OxFFFF for this instruction. For that reason, 
the notation and encoding are the same as for a write-mask. 


In conjunction with vpackstorelps, this instruction is useful for packing data into a queue. 
Also in conjunction with vpackstorelps, it allows unaligned vector stores (that is, vector 
stores that are only element-wise , not vector-wise, aligned); just use a mask of OxFFFF or 
no write-mask for this purpose. The typical instruction sequence to perform an unaligned 
vector store would be: 


// assume memory location is pointed by register rax 
vpackstorelps_ [rax] {k1}, vo 
vpackstorehps [rax+64] {ki}, vO 


This instruction does not have subset support. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element after down-conversion. 


Note that the address reported by a page fault is the beggining of the 64-byte cache line 
boundary containing the memory operand. The instruction will not produce any #GP or 
#SS fault due to address canonicity nor #PF fault if the address is aligned to a 64-byte 
boundary. Additionally, A/D bits in the page table will not be updated. 
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Operation 


storeOffset = 0 
downSize = DownConvStoreSize(f p32 (SSS[2:0]) 
foundNext64BytesBoundary = false 


pointer = m; - 64 
for (n = 0; n < 16; n++) f{ 
aeCci [aj t= 0) 
if (foundNext64BytesBoundary == false) { 


if ( ( (pointer + (store0ffset+1)*downSize) % 64) == 0) { 
foundNext64BytesBoundary = true 
} 
} else { 
i = 32*n 
tmp = DownConvStore 32 (zmmi[i+31:i], SSS[2:0]) 
if(downSize == 4) { 
MemStore (pointer + storeOffset*4) = tmp[31:0] 
} else if(downSize == 2) { 
MemStore (pointer + storeOffset*2) = tmp[15:0] 
} else if(downSize == 1) { 
MemStore (pointer + storeOffset) = tmp[7:0] 
} 
} 
store0ffset++ 
} 
} 
SIMD Floating-Point Exceptions 
Overflow, Underflow, Invalid, Precision, Denormal. 
Memory Down-conversion: D 32 
S2515o || Function: Usage disp8*N 
000 no conversion zmm1 4 
001 reserved N/A N/A 
010 reserved N/A N/A 
011 float32 to float16 zmm1 {float16} 2 
100 float32 to uint8 zmm1 {uint8} 1 
101 float32 to sint8 zmm1 {sint8} 1 
110 float32 to uint16 zmm1 {uint16} 2 
111 float32 to sint16 zmm1 {sint16} 2 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_extpackstorehi_ps (void*,_m512, MM_DOWNCONV_PS_ENUM, int); 

void _mm512_mask_extpackstorehi_ps (void*, _mmask16, _m512, 
_MM_DOWNCONV_PS _ENUM, int); 

void _mm512_packstorehi_ps (void*,__m512); 

void _mm512_mask_packstorehi_ps (void*, _mmask16,_m512); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 
#GP(0) 
#PF(fault-code) 


#NM 
#UD 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 

in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to element-wise data granularity dictated by the DownConv. 
For a page fault. 

If CRO.TS[bit 3]=1. 

If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 

If the fist operand is not a memory location. 
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Opcode Instruction Description 
MVEX.512.66.0F38.W1 D4  vpackstorehq me {k1}, Pack mask-enabled elements of int64 vector 
/v Diga(zmm1) zmm1 to form an unaligned int64 stream, 


down-convert it and logically map the stream 
starting at m, — 64, and store that portion 
of the stream that maps to the high 64-byte- 
aligned portion of the memory destination, un- 
der write-mask. 


Description 


Packs and down-converts the mask-enabled elements of int64 vector zmm1 into a int64 
stream logically mapped starting at element-aligned address (m, — 64), and stores the 
high-64-byte elements of that stream (those elements of the stream that map at or after 
the first 64-byte-aligned address following (m; — 64), the high cache line in the current 
implementation). The length of the stream depends on the number of enabled masks, as 
elements disabled by the mask are not added to the stream. 


The vpackstorelq instruction is used to store the part of the stream before the first 64- 
byte-aligned address preceding m:. 


The mask is not used as a write-mask for this instruction. Instead, the mask is used as an 
element selector, choosing which elements are added to the stream. The one similarity 
to a write-mask as used in the rest of this document is that the no-write-mask option 
(encoding 0) is available to select a mask of OxFF for this instruction. For that reason, the 
notation and encoding are the same as for a write-mask. 


In conjunction with vpackstorelq, this instruction is useful for packing data into a queue. 
Also in conjunction with vpackstorelq, it allows unaligned vector stores (that is, vector 
stores that are only element-wise , not vector-wise, aligned); just use a mask of OxFF or 
no write-mask for this purpose. The typical instruction sequence to perform an unaligned 
vector store would be: 


// assume memory location is pointed by register rax 
vpackstorelq [rax] {k1}, vo 
vpackstorehq [rax+64] {ki}, vO 


This instruction does not have subset support. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element after down-conversion. 


Note that the address reported by a page fault is the beggining of the 64-byte cache line 
boundary containing the memory operand. The instruction will not produce any #GP or 
#SS fault due to address canonicity nor #PF fault if the address is aligned to a 64-byte 
boundary. Additionally, A/D bits in the page table will not be updated. 
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Operation 


storeOffset = 0 
downSize = DownConvStoreSizeDf jg4 (SSS [2:0]) 
foundNext64BytesBoundary = false 


pointer = m: - 64 
for (n = 0; n < 8; nt++) { 
if(ki[m] != 0) f{ 
if (foundNext64BytesBoundary == false) { 
if ( ( (pointer + (store0ffset+1)*downSize) % 64) == 0) { 
foundNext64BytesBoundary = true 


} 
} else f{ 
i = 64*n 


tmp = DownConvStorejg4(zmmi [it+63:i], SSS[2:0]) 
if(downSize == 8) { 
MemStore (pointer + storeOffset*8) = tmp[63:0] 
} 
} 


store0ffset++ 


Flags Affected 


None. 


Memory Down-conversion: Dj¢4 


S25159 || Function: Usage disp8*N 
000 no conversion zmm1 8 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_extpackstorehi_epi64 (void*, _m512i, 
_MM_DOWNCONV_EPI64_ENUM, int); 
void _mm512_mask_extpackstorehi_epi64 (void*, _mmasks, _m512i, 


_MM_DOWNCONV_EPI64_ENUM, int); 
void _mm512_packstorehi_epi64 (void*, _m512i); 
void _mm512_mask_packstorehi_epi64 (void*, _mmask8, _m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to element-wise data granularity dictated by the DownConv. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If the fist operand is not a memory location. 
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Opcode Instruction Description 
MVEX.512.66.0F38.W0 DO vpackstoreld me {k1}, Pack mask-enabled elements of int32 vector 
/v Di32(zmm1) zmm1 to form an unaligned int32 stream, 


down-convert it and logically map the stream 
starting at m;, and store that portion of the 
stream that maps to the low 64-byte-aligned 
portion of the memory destination, under 
write-mask. 


Description 


Packs and down-converts the mask-enabled elements of int32 vector zmm1 into a byte/word/doubleword 
stream logically mapped starting at element-aligned address m,, and stores the low-64- 

byte elements of that stream (those elements of the stream that map before the first 64- 

byte-aligned address following m;, the low cache line in the current implementation). The 

length of the stream depends on the number of enabled masks, as elements disabled by 

the mask are not added to the stream. 


The vpackstorehd instruction is used to store the part of the stream at or after the first 
64-byte-aligned address preceding m. 


The mask is not used as a write-mask for this instruction. Instead, the mask is used as an 
element selector, choosing which elements are added to the stream. The one similarity 
to a write-mask as used in the rest of this document is that the no-write-mask option 
(encoding 0) is available to select a mask of OxFFFF for this instruction. For that reason, 
the notation and encoding are the same as for a write-mask. 


In conjunction with vpackstorehd, this instruction is useful for packing data into into a 
queue. Also in conjunction with vpackstorehd, it allows unaligned vector stores (that is, 
vector stores that are only element-wise, not vector-wise, aligned); just use a mask of 
OxFFFF or no write-mask for this purpose. The typical instruction sequence to perform 
an unaligned vector store would be: 


// assume memory location is pointed by register rax 
vpackstoreld [rax] {k1}, v0 
vpackstorehd [rax+64] {ki}, vO 


This instruction does not have subset support. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element after down-conversion. 


Note that the address reported by a page fault is the beggining of the 64-byte cache line 
boundary containing the memory operand. 
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Operation 


storeOffset = 0 
downSize = DownConvStoreSizeDf ;32(SSS[2:0]) 


for(n = 0 ;n < 16; nt++) f{ 
if (kifm] != 0) f 
i = 32*n 
tmp = DownConvStorej;32 (zmmi[it+31:i], SSS[2:0]) 
if(downSize == 4) { 
MemStore (m;+4*storeOffset) 
} else if(downSize == 2) { 
MemStore(m;+2*storeOffset) = tmp[15:0] 
} else if(downSize == 1) { 
MemStore(m;+storeOffset) = tmp[7:0] 
} 
storeOffsettt+ 
if (((m + downSize*storeOffset) % 64) == 0) { 
break 
} 
} 
} 


tmp [31:0] 


Flags Affected 


None. 


Memory Down-conversion: D;3. 


S2515So || Function: Usage disp8*N 
000 no conversion zmm1 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 uint32 to uint8 zmm1 {uint8} 1 

101 sint32 to sint8 zmm1 {sint8} 1 

110 uint32 to uint16 zmm1 {uint16} 2 

111 sint32 to sint16 zmm1 {sint16} 2 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_extpackstorelo_epi32 (void*, _m512i, 
_MM_DOWNCONV_EPI32_ENUM, int); 
void _mm512_mask_extpackstorelo_epi32 (void*, —_mmask16, _m512i, 


_MM_DOWNCONV_EPI32_ENUM, int); 
void _mm512_packstorelo_epi32 (void*, _m512i); 
void _mm512_mask_packstorelo_epi32 (void*,_mmask16,_m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to element-wise data granularity dictated by the DownConv. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If the fist operand is not a memory location. 
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Opcode Instruction Description 
MVEX.512.66.0F38.W1 D1 vpackstorelpd me {k1}, Pack mask-enabled elements of float64 vector 
/v D ea(zmm1) zmm1 to form an unaligned float64 stream, 


down-convert it and logically map the stream 
starting at m;, and store that portion of the 
stream that maps to the low 64-byte-aligned 
portion of the memory destination, under 
write-mask. 


Description 


Packs and down-converts the mask-enabled elements of float64 vector zmm1 into a 
float64 stream logically mapped starting at element-aligned address m;, and stores the 
low-64-byte elements of that stream (those elements of the stream that map before the 
first 64-byte-aligned address following m;, the low cache line in the current implemen- 
tation). The length of the stream depends on the number of enabled masks, as elements 
disabled by the mask are not added to the stream. 


The vpackstorehpd instruction is used to store the part of the stream at or after the first 
64-byte-aligned address preceding m. 


The mask is not used as a write-mask for this instruction. Instead, the mask is used as an 
element selector, choosing which elements are added to the stream. The one similarity 
to a write-mask as used in the rest of this document is that the no-write-mask option 
(encoding 0) is available to select a mask of OxFF for this instruction. For that reason, the 
notation and encoding are the same as for a write-mask. 


In conjunction with vpackstorehpd, this instruction is useful for packing data into into a 
queue. Also in conjunction with vpackstorehpd, it allows unaligned vector stores (that 
is, vector stores that are only element-wise, not vector-wise, aligned); just use a mask of 
OxFF or no write-mask for this purpose. The typical instruction sequence to perform an 
unaligned vector store would be: 


// assume memory location is pointed by register rax 
vpackstorelpd [rax] {k1}, vo 
vpackstorehpd [rax+64] {ki}, vO 


This instruction does not have subset support. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element after down-conversion. 


Note that the address reported by a page fault is the beggining of the 64-byte cache line 
boundary containing the memory operand. 
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Operation 


storeOffset = 0 
downSize = DownConvStoreSizeOf fe64 (SSS [2:0] ) 


for(n = 0 ;n < 8; n++) f{ 
if (kifm] != 0) { 
i = 64*n 
tmp = DownConvStore rg4(zmm1[i+63:i], SSS[2:0]) 
if(downSize == 8) { 
MemStore (m;+8*storeOffset) = tmp[63:0] 
} 
storeOffsettt+ 
if (((m + downSize*storeOffset) % 64) == 0) { 
break 
} 
} 
} 


SIMD Floating-Point Exceptions 


None. 


Memory Down-conversion: D 64 


S55S1Spo || Function: Usage disp8*N 
000 no conversion zmm1 8 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_extpackstorelo_pd (void*,__m512d,_MM_DOWNCONV_PD_ENUM, int); 

void _mm512_mask_extpackstorelo_pd (void*, _mmaské, _m512d, 
_MM_DOWNCONV_PD_ENUM, int); 

void _mm512_packstorelo_pd (void*,__m512d); 

void _mm512_mask_packstorelo_pd (void*, _mmask8,__m512d); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to element-wise data granularity dictated by the DownConv. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If the fist operand is not a memory location. 
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Opcode Instruction Description 
MVEX.512.66.0F38.W0 D1 vpackstorelps me {k1}, Pack mask-enabled elements of float32 vector 
/v D32(zmm1) zmm1 to form an unaligned float32 stream, 


down-convert it and logically map the stream 
starting at m,;, and store that portion of the 
stream that maps to the low 64-byte-aligned 
portion of the memory destination, under 
write-mask. 


Description 


Packs and down-converts the mask-enabled elements of float32 vector zmm1 into a 
byte /word/doubleword stream logically mapped starting at element-aligned address m,, 
and stores the low-64-byte elements of that stream (those elements of the stream that 
map before the first 64-byte-aligned address following m,, the low cache line in the cur- 
rent implementation). The length of the stream depends on the number of enabled masks, 
as elements disabled by the mask are not added to the stream. 


The vpackstorehps instruction is used to store the part of the stream at or after the first 
64-byte-aligned address preceding m. 


The mask is not used as a write-mask for this instruction. Instead, the mask is used as an 
element selector, choosing which elements are added to the stream. The one similarity 
to a write-mask as used in the rest of this document is that the no-write-mask option 
(encoding 0) is available to select a mask of OxFFFF for this instruction. For that reason, 
the notation and encoding are the same as for a write-mask. 


In conjunction with vpackstorehps, this instruction is useful for packing data into into a 
queue. Also in conjunction with vpackstorehps, it allows unaligned vector stores (that 
is, vector stores that are only element-wise, not vector-wise, aligned); just use a mask of 
OxFFFF or no write-mask for this purpose. The typical instruction sequence to perform 
an unaligned vector store would be: 


// assume memory location is pointed by register rax 
vpackstorelps_ [rax] {k1}, v0 
vpackstorehps [rax+64] {ki}, vO 


This instruction does not have subset support. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element after down-conversion. 


Note that the address reported by a page fault is the beggining of the 64-byte cache line 
boundary containing the memory operand. 
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Operation 


storeOffset = 0 
downSize = DownConvStoreSizeOf p32 (SSS [2:0] ) 


for(n = 0 ;n < 16; nt++) f{ 
if (kilm] != 0) f 
i = 32*n 
tmp = DownConvStore 32 (zmmi[it+31:i], SSS[2:0]) 
if(downSize == 4) { 
MemStore(m;+4*storeOffset) = tmp[31:0] 
} else if(downSize == 2) { 
MemStore (m;+2*storeOffset) 
} else if(downSize == 1) { 
MemStore(m;+storeOffset) = tmp[7:0] 
} 
storeOffsett+ 
if (C((m + downSize*storeOffset) % 64) == 0) { 
break 
} 
} 
} 


tmp [15:0] 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Memory Down-conversion: D ;35 


S2515o || Function: Usage disp8*N 
000 no conversion zmm1 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 float32 to float16 zmm1 {float16} 2 

100 float32 to uint8 zmm1 {uint8} 1 

101 float32 to sint8 zmm1 {sint8} 1 

110 float32 to uint16 zmm1 {uint16} 2 

111 float32 to sint16 zmm1 {sint16} 2 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_extpackstorelo_ps (void*, _m512, MM_DOWNCONV_PS_ENUM, int); 

void _mm512_mask_extpackstorelo_ps (void*, —_mmask16, 
_MM_DOWNCONV_PS ENUM, int); 

void _mm512_packstorelo_ps (void*, __m512); 

void _mm512_mask_packstorelo_ps (void*,_mmask16,__m512); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 
#GP(0) 
#PF(fault-code) 


#NM 
#UD 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 

in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to element-wise data granularity dictated by the DownConv. 
For a page fault. 

If CRO.TS[bit 3]=1. 


If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If the fist operand is not a memory location. 
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Opcode Instruction Description 
MVEX.512.66.0F38.W1 DO vpackstorelq me {k1}, Pack mask-enabled elements of int64 vector 
/v Diga(zmm1) zmm1 to form an unaligned int64 stream, 


down-convert it and logically map the stream 
starting at m;, and store that portion of the 
stream that maps to the low 64-byte-aligned 
portion of the memory destination, under 
write-mask. 


Description 


Packs and down-converts the mask-enabled elements of int64 vector zmm1 into a int64 
stream logically mapped starting at element-aligned address m;,, and stores the low-64- 
byte elements of that stream (those elements of the stream that map before the first 64- 
byte-aligned address following m;, the low cache line in the current implementation). The 
length of the stream depends on the number of enabled masks, as elements disabled by 
the mask are not added to the stream. 


The vpackstorehq instruction is used to store the part of the stream at or after the first 
64-byte-aligned address preceding m. 


The mask is not used as a write-mask for this instruction. Instead, the mask is used as an 
element selector, choosing which elements are added to the stream. The one similarity 
to a write-mask as used in the rest of this document is that the no-write-mask option 
(encoding 0) is available to select a mask of OxFF for this instruction. For that reason, the 
notation and encoding are the same as for a write-mask. 


In conjunction with vpackstorehg, this instruction is useful for packing data into into a 
queue. Also in conjunction with vpackstorehgq, it allows unaligned vector stores (that is, 
vector stores that are only element-wise, not vector-wise, aligned); just use a mask of 
OxFF or no write-mask for this purpose. The typical instruction sequence to perform an 
unaligned vector store would be: 


// assume memory location is pointed by register rax 
vpackstorelq  [rax] {k1}, v0 
vpackstorehq [raxt+64] {ki}, vO 


This instruction does not have subset support. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element after down-conversion. 


Note that the address reported by a page fault is the beggining of the 64-byte cache line 
boundary containing the memory operand. 
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Operation 


storeOffset = 0 
downSize = DownConvStoreSize0f jg4 (SSS [2:0]) 


for(n = 0 ;n < 8; n++) { 
if (kifm] != 0) { 
i = 64*n 
tmp = DownConvStorejg4(zmmi [it+63:i], SSS[2:0]) 
if(downSize == 8) { 
MemStore (m;+8*storeOffset) = tmp[63:0] 
} 
storeOffsettt+ 
if (((m, + downSize*storeOffset) % 64) == 0) { 
break 
} 
} 
} 


Flags Affected 


None. 


Memory Down-conversion: Dj¢4 


S251Spo || Function: Usage disp8*N 
000 no conversion zmm1 8 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_extpackstorelo_epi64 (void*, _m512i, 
_MM_DOWNCONV_EPI64_ENUM, int); 
void _mm512_mask_extpackstorelo_epi64 (void*, _mmaské, _m512i, 


_MM_DOWNCONV_EPI64_ENUM, int); 
void _mm512_packstorelo_epi64 (void*, _m512i); 
void _mm512_mask_packstorelo_epi64 (void*, mmask8,_m512i); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to element-wise data granularity dictated by the DownConv. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If the fist operand is not a memory location. 
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VPADCD - Add Int32 Vectors with Carry 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.WO vpadcd zmm1_ {ki}, k2, Add int32 vector S;32(zmm3/m,), vector mask 
5C /r Sizo(zmm3/mz) register k2 and int32 vector zmm1 and store 


the result in zmm1, and the carry of the sum in 
k2, under write-mask. 


Description 


Performs an element-by-element three-input addition between int32 vector zmm1, the 
int32 vector result of the swizzle/broadcast/conversion process on memory or int32 vec- 
tor zmm3, and the corresponding bit of k2. The result is written into int32 vector zmm1. 


In addition, the carry from the sum for the n-th element is written into the n-th bit of 
vector mask k2. 


This instruction is write-masked, so only those elements with the corresponding bit set in 
vector mask register k1 are computed and stored into zmm1 and k2. Elements in zmm1 
and k2 with the corresponding bit clear in k1 retain their previous value. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) { 
if(ki{m] != 0) f{ 
i = 32*n 
// integer operation 
tmpCarry = Carry(zmm1[i+31:i] + k2[n] + tmpSrc3[i+31:i]) 
zmm1[i+31:i] = zmmi[i+31:i] + k2[n] + tmpSrc3[i+31:i] 
k2[n] = tmpCarry 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S251So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S55S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_adc_epi32(_m512i,__mmask16,__m512i,__mmask16*); 
—m512i _mm512_mask_adc_epi32(_m512i, __mmask16, _mmask16, _m512i, 
__mmask16*); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
#UD 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 


If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 


431 


(intel 
CHAPTER 6. INSTRUCTION DESCRIPTIONS 


VPADDD - Add Int32 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F.W0O vpaddd zmmi_ {k1}, zmm2, Add int32 vector zmm2 and int32 vector 

FE /r Si32(zmm3/m;) Si32(zmm3/m,) and store the result in zmm1, 
under write-mask. 


Description 


Performs an element-by-element addition between int32 vector zmm2 and the int32 vec- 
tor result of the swizzle/broadcast/conversion process on memory or int32 vector zmm3. 
The result is written into int32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
ie tki [a]: I= 0). 4 
i = 32*n 
// integer operation 
zmm1[i+31:i] = zmm2[i+31:i] + tmpSrc3[it+31:i] 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_add_epi32 (_m512i,__m512i); 
—m512i _mm512_mask_add_epi32 (_m512i,_mmask16,__m512i,__m512i); 
Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPADDSETCD - Add Int32 Vectors and Set Mask to Carry 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.WO vpaddsetcd zmmt1_ {k1}, k2, Add int32 vector zmm1 and int32 vector 
5D /r Si32(zmm3/m,) Si32(zmm3/m,) and store the sum in zmm1 
and the carry from the sum in k2, under write- 
mask. 
Description 


Performs an element-by-element addition between int32 vector zmm1 and the int32 vec- 
tor result of the swizzle/broadcast/conversion process on memory or int32 vector zmm3. 
The result is written into int32 vector zmm1. 


In addition, the carry from the sum for the n-th element is written into the n-th bit of 
vector mask k2. 


This instruction is write-masked, so only those elements with the corresponding bit set in 
vector mask register k1 are computed and stored into zmm1 and k2. Elements in zmm1 
and k2 with the corresponding bit clear in k1 retain their previous value. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj;39 (zmm3/m;,) 

} 


for (n = 0; n < 16; n++) f{ 
if(ki[n} t= 0) 4 
i = 32*n 
// integer operation 
k2[n] = Carry(zmm1[it31:i] + tmpSrc3[it+31:i]) 
zmm1[i+31:i] = zmmi[i+31:i] + tmpSrc3[it+31:i] 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S251So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S55S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_addsetc_epi32 (_m512i,__m512i,__mmask16*); 
_—m512i _mm512_mask_addsetc_epi32 (_m512i, _mmask16 
__mmask16*); 


mmask16, _m512i, 


[a 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
#UD 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 


If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 


437 


(intel 
CHAPTER 6. INSTRUCTION DESCRIPTIONS 


VPADDSETSD - Add Int32 Vectors and Set Mask to Sign 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.W0 CD /r vpaddsetsd zmm1 {k1}, zmm2, S;32(zmm3/m,) Add  int32  vec- 
tor zmm2_ and 
int32 vector 
Sizo(zmm3/mz) 
and store the sum in 
zmm1 and the sign 
from the sum in k1, 
under write-mask. 


Description 


Performs an element-by-element addition between int32 vector zmm2 and the int32 vec- 
tor result of the swizzle/broadcast/conversion process on memory or int32 vector zmm3. 
The result is written into int32 vector zmml1. 


In addition, the sign of the result for the n-th element is written into the n-th bit of vector 
mask k1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
if(ki[m] != 0) f{ 
i = 32*n 
// signed integer operation 
zmm1[i+31:i] = zmm2[i+31:i] + tmpSrc3[it+31:i] 
ki ({m] = zmmi[i+31] 
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Flags Affected 


None. 


Memory Up-conversion: S;35 


S251So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S25S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_addsets_epi32 (_m512i,__m512i,__mmask16*); 
_—m512i _mm512_mask_addsets_epi32 (_m512i, _mmask16, _m512i, _m512i, 
__mmask16*); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 
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Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If any memory operand linear address is not aligned to 4-byte 
data granularity. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If no write mask is provided or selected write-mask is k0. 
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VPANDD - Bitwise AND Int32 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F.W0O vpandd zmmi_ {k1}, zmm2, Perform a bitwise AND between int32 vector 

DB /r Sizo(zmm3/mz) zmm_2 and int32 vector 5;32(zmm3/m;) and 
store the result in zmm1, under write-mask. 


Description 


Performs an element-by-element bitwise AND between int32 vector zmmz2 and the int32 
vector result of the swizzle/broadcast/conversion process on memory or int32 vector 
zmm3. The result is written into int32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) { 
if(ki[n] != 0) { 
i = 32*n 
zmm1[i+31:i] = zmm2[i+31:i] & tmpSrc3[it31:i] 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;3. 


MVEX.EH=0 

S25S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_and_epi32(_m512i,__m512i); 
—m512i _mm512_mask_and_epi32(_m512i,_mmask16,_m512i, _m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPANDND - Bitwise AND NOT Int32 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F.W0 vpandnd zmmi1 {k1}, zmm2, Performa bitwise AND between NOT int32 vec- 

DF /r Sizo(zmm3/mz) torzmm2 and int32 vector S;32(zmm3/m;) and 
store the result in zmm1, under write-mask. 


Description 


Performs an element-by-element bitwise AND between NOT int32 vector zmm2 and the 
int32 vector result of the swizzle/broadcast/conversion process on memory or int32 vec- 
tor zmm3. The result is written into int32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
if(kif{m] != 0) { 
i = 32*n 
zmmi[i+31:i] = (~(zmm2[i+31:i])) & tmpSrc3[i+31:i] 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S251 So 


Function: 


Usage 


disp8*N 


000 
001 
010 
011 
100 
101 
110 
111 


no conversion 

broadcast 1 element (x16) 
broadcast 4 elements (x4) 
reserved 

uint8 to uint32 

sint8 to sint32 

uint16 to uint32 

sint16 to sint32 


[rax] {16to16} or [rax] 
[rax] {1to16} 

[rax] {4to16} 

N/A 

[rax] {uint8} 

[rax] {sint8} 

[rax] {uint16} 

[rax] {sint16} 


64 


Register Swizzle: S;3. 


MVEX.EH=0 

S25S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i 
—m512i 


Exceptions 


_mm512_andnot_epi32 (_m512i,_m512i); 
_mm512_mask_andnot_epi32 (_m512i,__mmask16,__m512i,__m512i); 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
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#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPANDNQ - Bitwise AND NOT Int64 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0FW1 vpandnq zmm1 {k1}, zmm2, Performa bitwise AND between NOT int64 vec- 

DF /r Siga(zmm3/mz) torzmm2 and int64 vector Sig4(zmm3/m;) and 
store the result in zmm1, under write-mask. 


Description 


Performs an element-by-element bitwise AND between NOT int64 vector zmm2 and the 
int64 vector result of the swizzle/broadcast/conversion process on memory or int64 vec- 
tor zmm3. The result is written into int64 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadjg4(zmm3/m;) 

} 


for (n = 0; n < 8; n++) { 
if(kifm] != 0) { 
i = 64*n 
zmmi[i+63:i] = (~(zmm2[i+63:i])) & tmpSrc3[i+63:i] 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;¢4 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Register Swizzle: S;¢4 


MVEX.EH=0 

S55S1Spo || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_andnot_epi64(_m512i,__m512i); 


_—m512i _mm512_mask_andnot_epi64(_m512i,_ mmask8,_m512i,__m512i); 


i I 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPANDQ - Bitwise AND Int64 Vectors 


450 


Opcode Instruction Description 
MVEX.NDS.512.66.0FW1 vpandq zmmi1_ {k1}, zmm2, Perform a bitwise AND between int64 vector 
DB /r Siga(zmm3/mz) zmm_2 and int64 vector Sjg4(zmm3/m;) and 


store the result in zmm1, under write-mask. 


Description 


Performs an element-by-element bitwise AND between int64 vector zmmz2 and the int64 
vector result of the swizzle/broadcast/conversion process on memory or int64 vector 
zmm3. The result is written into int32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadjg4(zmm3/m;) 

} 


for (n = 0; n < 8; nt++) f{ 
if(ki[n] != 0) { 
i = 64*n 
zmm1[i+63:i] = zmm2[i+63:i] & tmpSrc3[it+63:i] 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;¢4 
S25159 || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 
001 broadcast 1 element (x8) [rax] {1to8} 8 
010 broadcast 4 elements (x2) | [rax] {4to8} 32 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
Register Swizzle: S;e. 

MVEX.EH=0 

S55S1Spo || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_and_epi64(_m512i,__m512i); 


—m512i _mm512_mask_and_epi64(_m512i,_mmask8,_m512i,_m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPBLENDMD - Blend Int32 Vectors using the Instruction Mask 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.WO vpblendmd zmm1 {k1}, zmm2, Blend int32 vector zmm2 and int32 vector 

64 /r Sizo(zmm3/mz) Siz30(zmm3/m;) and store the result in zmm1, 
under write-mask. 


Description 


Performs an element-by-element blending between int32 vector zmm2 and the int32 vec- 
tor result of the swizzle/broadcast/conversion process on memory or int32 vector zmm3, 
using the instruction mask as selector. The result is written into int32 vector zmm1. 


The mask is not used as a write-mask for this instruction. Instead, the mask is used as an 
element selector: every element of the destination is conditionally selected between first 
source or second source using the value of the related mask bit (0 for first source, 1 for 
second source ). 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 
tmpSrc3[511:0] = tmpSrc3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (tmpSrc3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
if (k1[m]==1 or *no write-mask*) { 
zmmi(i+31:i] = tmpSrc3[i+31:i] 
} else { 
zmmi1[i+31:i] = zmm2[i+31:i] 


} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;3. 


MVEX.EH=0 

S25S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_mask_blend_epi32 (_mmask16,__m512i,__m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPBLENDMQ - Blend Int64 Vectors using the Instruction Mask 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.W1 vpblendmq zmm1 {k1}, zmm2, Blend int64 vector zmm2 and int64 vector 

64 /r Siga(zmm3/mz) Siga4(zmm3/m;) and store the result in zmm1, 
under write-mask. 


Description 


Performs an element-by-element blending between int64 vector zmm2 and the int64 vec- 
tor result of the swizzle/broadcast/conversion process on memory or int64 vector zmm3, 
using the instruction mask as selector. The result is written into int64 vector zmm1. 


The mask is not used as a write-mask for this instruction. Instead, the mask is used as an 
element selector: every element of the destination is conditionally selected between first 
source or second source using the value of the related mask bit (0 for first source, 1 for 
second source ). 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 
tmpSrc3[511:0] = tmpSrc3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadjg4 (tmpSrc3/m;) 

} 


for (n = 0; n < 8; n++) { 
if (k1[m]==1 or *no write-mask*) { 
zmmi[i+63:i] = tmpSrc3[i+63:i] 
} else f{ 
zmmi1[i+63:i] = zmm2[i+63:i] 


} 


Flags Affected 


None. 
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Memory Up-conversion: S64 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 
001 broadcast 1 element (x8) [rax] {1to8} 8 
010 broadcast 4 elements (x2) | [rax] {4to8} 32 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
Register Swizzle: S;¢4 

MVEX.EH=0 

S25S1Spo || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i 


Exceptions 


_mm512_mask_blend_epi64 (_mmask8,__m512i,__m512i); 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 


Instruction not available in these modes 
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#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPBROADCASTD - Broadcast Int32 Vector 


Opcode Instruction Description 
MVEX.512.66.0F38.W0 58  vpbroadcastd zmm1 {k1}, Broadcast int32 vector Uj32(m:z) into vector 
/r Ui32(m+) zmm1, under write-mask. 

Description 


The 1, 2, or 4 bytes (depending on the conversion and broadcast in effect) at memory 
address m; are broadcast and/or converted to a int32 vector. The result is written into 


int32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 


the corresponding bit clear in k1 retain their previous values. 


Operation 


// {1t016} 


tmpSrc2[31:0] = UpConvLoad;32 (mz) 


for (n = 0; n < 16; nt+) { 


if (ki[n] != 0) { 
i = 32*n 
zmmi1[i+31:i] = tmpSrc2[31:0] 
} 
} 
Flags Affected 
None. 


Memory Up-conversion: U;35 


525159 || Function: Usage disp8*N 
000 no conversion [rax] 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 1 

101 sint8 to sint32 [rax] {sint8} 1 

110 uint16 to uint32 [rax] {uint16} 2 

111 sint16 to sint32 [rax] {sint16} 2 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_extload_epi32(void const*, MM_UPCONV_EPI32_ENUM, 
_MM_BROADCAST32_ENUM, int); 
_—m512i _mm512_mask_extload_epi32(__m512i, _mmask16, void 


const*, MM_UPCONV_EPI32_ENUM, MM_BROADCAST32_ENUM, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPBROADCASTQ - Broadcast Int64 Vector 


Opcode Instruction Description 
MVEX.512.66.0F38.W1 59 vpbroadcastq zmm1 {k1}, Broadcast int64 vector Ujg4(m:z) into vector 
/r Uiea(me) zmm1, under write-mask. 

Description 


The 8 bytes at memory address m, are broadcast to a int64 vector. The result is written 


into int64 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 


the corresponding bit clear in k1 retain their previous values. 


Operation 


// {1to8} 
tmpSrc2[63:0] = UpConvLoadjg4 (m+) 
for (n = 0; n < 8; n++) { 
if (kifm] != 0) { 
i = 64*n 
zmmi[i+63:i] = tmpSrc2[63:0] 
} 
} 


Flags Affected 


None. 


Memory Up-conversion: Uj¢4 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] 8 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_extload_epi64(void const*, MM_UPCONV_EPI64_ENUM, 
_MM_BROADCAST64_ENUM, int); 
_—m512i _mm512_mask_extload_epi64(__m512i, —_mmask16, void 


const*, MM_UPCONV_EPI64_ENUM, MM_BROADCAST64_ENUM, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPCMPD - Compare Int32 Vectors and Set Vector Mask 


Opcode Instruction Description 

MVEX.NDS.512.66.0F3A.WO 1F /rib) vpcmpd k2 {k1}, zmm1, Sj30(zmm2/m,),imm8 Compare be- 
tween int32 
vector zmm1 
and int32 vector 
Si32(zmm2/mz) 
and store the re- 
sult in k2, under 
write-mask. 


Description 


Performs an element-by-element comparison between int32 vector zmm1 and the int32 
vector result of the swizzle/broadcast/conversion from memory or int32 vector zmmz2. 
The result is written into vector mask k2. 


The write-mask does not perform the normal write-masking function for this instruction. 
While it does enable/disable comparisons, it does not block updating of the destination; 
instead, if a write-mask bit is 0, the corresponding destination bit is set to 0. Nonethe- 
less, the operation is similar enough so that it makes sense to use the usual write-mask 
notation. This mode of operation is desirable because the result will be used directly as a 
write-mask, rather than the normal case where the result is used with a separate write- 
mask that keeps the masked elements inactive. 


Immediate Format 


Comparison Type In IT, Ip 

eq | Equal 0 0 O 
It | Less than 0 oO 1 
le | Less than or Equal 0 1 O 
neq | Not Equal 1 oO O 
nlt | Not Less than 1 oO 1 
nle | NotLessthanorEqual | 1 1 0 


Operation 


switch (IMM8[2:0]) { 


case 0: OP + EQ; break; 
case 1: OP + LT; break; 
case 2: OP + LE; break; 
case 4: OP + NEQ; break; 
case 5: OP + NLT; break; 


Reference Number: 327364-001 463 


> 
D 


CHAPTER 6. INSTRUCTION DESCRIPTIONS 


case 6: OP + WNLE; break; 
default: Reserved; break; 


i 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc2[511:0] = zmm2[511:0] 

} else { 
tmpSrc2[511:0] = SwizzUpConvLoadj32 (zmm2/m;) 


} 
for (n = 0; n < 16; nt+) { 
k2[n] = 0 
if(ki[m] != 0) f{ 
i = 32*n 


// signed integer operation 
k2[n] = (zmm1[i+31:i] OP tmpSrc2[it+31:i]) 7? 1:0 
} 
} 


Instruction Pseudo-ops 


Compilers and assemblers may implement the following pseudo-ops in addition to the 
standard instruction op: 


Pseudo-Op Implementation 

vpcmpeqd k2 {k1}, zmm1, S;(zmm2/m) vempd k2 {k1}, zmm1, S;(zmm2/m,), {eq} 

vpcmpltd k2 {k1}, zmm1, S;(zmm2/m;) vempd k2 {k1}, zmm1, S;(zmm2/mz), {It} 

vpcmpled k2 {k1}, zmm1, S;(zmm2/m;) vempd k2 {k1}, zmm1, S;(zmm2/mz), {le} 

vpcmpneqd k2 {k1}, zmm1, $;(zmm2/m) vempd k2 {k1}, zmm1, S;(zmm2/mz,), {neq} 

vpcmpnitd k2 {k1}, zmm1, S;(zmm2/m:) vempd k2 {k1}, zmm1, S;(zmm2/mz), {nlt} 

vpcmpnled k2 {k1}, zmm1, 5;(zmm2/m;) vempd k2 {k1}, zmm1, S;(zmm2/mz,), {nle} 
Flags Affected 

None. 
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Memory Up-conversion: S;35 


S251So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S55S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—mmask16 _mm512_cmp_epi32_mask(_m512i,__m512i, const_MM_CMPINT_ENUM); 
_mmask16 _mm512_mask_cmp_epi32_mask(_mmask16, _m512i, _m512i, const 
_MM_CMPINT_ENUM); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 

#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 

#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 
mode. 

#PF(fault-code) For a page fault. 

#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPCMPEQD - Compare Equal Int32 Vectors and Set Vector Mask 


Opcode Instruction 


MVEX.NDS.512.66.0F.W0 76 /r vpcmpeqd k2 {k1}, zmm1, Sj32(zmm2/m) 


Description 
Compare Equal be- 
tween int32 vector 


zmmi1 and int32 vector 
Sizo(zmm2/m;,), and set 
vector mask k2 to reflect 
the zero/non-zero status of 
each element of the result, 
under write-mask. 


Description 


Performs an element-by-element compare for equality between int32 vector zmm1 and 
the int32 vector result of the swizzle/broadcast/conversion from memory or int32 vector 


zmmz. The result is written into vector mask k2. 


The write-mask does not perform the normal write-masking function for this instruction. 
While it does enable/disable comparisons, it does not block updating of the destination; 
instead, if a write-mask bit is 0, the corresponding destination bit is set to 0. Nonethe- 
less, the operation is similar enough so that it makes sense to use the usual write-mask 
notation. This mode of operation is desirable because the result will be used directly as a 
write-mask, rather than the normal case where the result is used with a separate write- 


mask that keeps the masked elements inactive. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 


tmpSrc2[511:0] = zmm2[511:0] 
} else { 
tmpSrc2[511:0] = SwizzUpConvLoadj32 (zmm2/m;) 


} 
for (n = 0; n < 16; n++) { 
k2[n] = 0 
if(ki[n] != 0) { 
i = 32*n 


// signed integer operation 
k2[n] = (zmmi[i+31:i] == tmpSrc2[i+31:i]) 7 1 
} 
} 
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Flags Affected 


None. 


Memory Up-conversion: S;35 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;3. 


MVEX.EH=0 

S255 || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—mmask16 _mm512_cmpeq_epi32_mask (_m512i,__m512i); 
_mmask16 _mm512_mask_cmpeq_epi32_mask (_mmask16, _m512i,__m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 
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#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPCMPGTD - Compare Greater Than Int32 Vectors and Set Vector Mask 


470 


Opcode Instruction Description 

MVEX.NDS.512.66.0F.W0 66 /r vpcmpgtd k2 {k1}, zmm1, S;32(zmm2/m,) Compare Greater between 
int32 vector zmm1 and int32 
vector S;32(zmm2/m,), and 
set vector mask k2 to reflect 
the zero/non-zero status of 
each element of the result, 
under write-mask. 


Description 


Performs an element-by-element compare for the greater value of int32 vector zmm1 and 
the int32 vector result of the swizzle/broadcast/conversion from memory or int32 vector 
zmm2. The result is written into vector mask k2. 


The write-mask does not perform the normal write-masking function for this instruction. 
While it does enable/disable comparisons, it does not block updating of the destination; 
instead, if a write-mask bit is 0, the corresponding destination bit is set to 0. Nonethe- 
less, the operation is similar enough so that it makes sense to use the usual write-mask 
notation. This mode of operation is desirable because the result will be used directly as a 
write-mask, rather than the normal case where the result is used with a separate write- 
mask that keeps the masked elements inactive. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc2[511:0] = zmm2[511:0] 

} else { 
tmpSrc2[511:0] = SwizzUpConvLoadj32 (zmm2/m;) 


} 
for (n = 0; n < 16; n++) { 
k2[n] = 0 
if(ki[n] != 0) { 
i = 32*n 


// signed integer operation 
k2[n] = (zmm1[i+31:i] > tmpSrc2[i+31:i]) ? 1: 0 
} 
} 
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Flags Affected 


None. 


Memory Up-conversion: S;35 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;3. 


MVEX.EH=0 

S255 || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_mmask16 _mm512_cmpgt_epi32_mask (_m512i,_m512i); 
_mmask16 _mm512_mask_cmpgt_epi32_mask (_mmask16,_m512i,_m512i); 
Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 
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#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPCMPLTD - Compare Less Than Int32 Vectors and Set Vector Mask 


Opcode Instruction 


MVEX.NDS.512.66.0F38.W0 74 /r_ vpcmpltd k2 {k1}, zmm1, Sj32(zmm2/m) 


Description 

Compare Less be- 
tween int32 vector 
zmmi1 and int32 vector 
Sizo(zmm2/m;,), and set 
vector mask k2 to reflect 
the zero/non-zero status 
of each element of the 
result, under write-mask. 


Description 


Performs an element-by-element compare for the lesser value of int32 vector zmm1 and 
the int32 vector result of the swizzle/broadcast/conversion from memory or int32 vector 


zmmz. The result is written into vector mask k2. 


The write-mask does not perform the normal write-masking function for this instruction. 
While it does enable/disable comparisons, it does not block updating of the destination; 
instead, if a write-mask bit is 0, the corresponding destination bit is set to 0. Nonethe- 
less, the operation is similar enough so that it makes sense to use the usual write-mask 
notation. This mode of operation is desirable because the result will be used directly as a 
write-mask, rather than the normal case where the result is used with a separate write- 


mask that keeps the masked elements inactive. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 


tmpSrc2[511:0] = zmm2[511:0] 
} else { 
tmpSrc2[511:0] = SwizzUpConvLoadj32 (zmm2/m;) 


} 
for (n = 0; n < 16; n++) { 
k2[n] = 0 
if(ki[n] != 0) { 
i = 32*n 


// signed integer operation 


k2[n] = (zmm1[i+31:i] < tmpSrc2[i+31:i]) 7? 1: 


} 
} 
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Flags Affected 


None. 


Memory Up-conversion: S;35 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;3. 


MVEX.EH=0 

S255 || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—mmask16 _mm512_cmplt_epi32_mask (_m512i,__m512i); 
_mmask16 _mm512_mask_cmplt_epi32_mask (_mmask16,_m512i,__m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 
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#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
#UD 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 


If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPCMPUD - Compare Uint32 Vectors and Set Vector Mask 
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Opcode 


Instruction 


Description 


MVEX.NDS.512.66.0F3A.WO 1E /rib) vpcmpud k2 {k1}, zmm1, S;32(zmm2/m,),imm8 Compare 


between 

uint32 vec- 
tor zmm1 and 
uint32 vector 
Sizo(zmm2/m:z) 

and store the re- 
sult in k2, under 
write-mask. 


Description 


Performs an element-by-element comparison between uint32 vector zmm1 and the 
uint32 vector result of the swizzle/broadcast/conversion from memory or uint32 vector 
zmmz2. The result is written into vector mask k2. 


The write-mask does not perform the normal write-masking function for this instruction. 
While it does enable/disable comparisons, it does not block updating of the destination; 
instead, if a write-mask bit is 0, the corresponding destination bit is set to 0. Nonethe- 
less, the operation is similar enough so that it makes sense to use the usual write-mask 
notation. This mode of operation is desirable because the result will be used directly as a 
write-mask, rather than the normal case where the result is used with a separate write- 
mask that keeps the masked elements inactive. 


Immediate Format 


Operation 


switch (IMM8[2: 
0% 


case 
case 
case 
case 


OP 


1: OP 
2: 
4: OP 


OP 


Comparison Type Ig IT, Ip 

eq | Equal 0 0 O 
It | Less than 0 oO 1 
le | Less than or Equal 0 1 O 
neq | Not Equal 1 0 0O 
nlt | Not Less than 1 oO 1 
nle | NotLessthanorEqual | 1 1 0 


0]) ¢f 

«+ EQ; break; 
«+ LT; break; 
«+ LE; break; 
«+ NEQ; break; 
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case 5: OP + NLT; break; 
case 6: OP + WNLE; break; 
default: Reserved; break; 


} 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc2[511:0] = zmm2[511:0] 

} else { 
tmpSrc2[511:0] = SwizzUpConvLoadj32 (zmm2/m;) 


} 
for (n = 0; n < 16; nt+) { 
k2[n] = 0 
if(ki[m] != 0) f{ 
i = 32*n 


// unsigned integer operation 
k2[n] = (zmm1[i+31:i] OP tmpSrc2[i+31:i]) 7 1:0 
} 
} 


Instruction Pseudo-ops 


Compilers and assemblers may implement the following pseudo-ops in addition to the 
standard instruction op: 


Pseudo-Op Implementation 

vpcmpequd k2 {k1}, zmm1, S;(zmm2/m,) vempud k2 {k1}, zmm1, S;(zmm2/mz), {eq} 

vpcmpltud k2 {k1}, zmm1, S;(zmm2/m:) vempud k2 {k1}, zmm1, S;(zmm2/mz«), {It} 

vpcmpleud k2 {k1}, zmm1, S;(zmm2/m:) vempud k2 {k1}, zmm1, S;(zmm2/mz,), {le} 

vpcmpnequd k2 {k1}, zmm1, S;(zmm2/m,) vempud k2 {k1}, zmm1, S;(zmm2/mz,), {neq} 

vpcmpniltud k2 {k1}, zmm1, S;(zmm2/m:) vempud k2 {k1}, zmm1, S;(zmm2/mz), {nlt} 

vpcmpnleud k2 {k1}, zmm1, S;(zmm2/mz) vempud k2 {k1}, zmm1, S;(zmm2/mz,), {nle} 
Flags Affected 

None. 
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Memory Up-conversion: S;35 


S251So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S55S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—_mmask16 
_mmask16 _mm512_mask_cmp_epi32_mask(_mmask16, 
_MM_CMPINT_ENUM); 
Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


_mm512_cmp_epi32_mask(_m512i,__m512i, const _MM_CMPINT_ENUM); 
_m512i, 


_m512i, 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 
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Instruction not available in these modes 


const 
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64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPERMD - Permutes Int32 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.WO vpermd zmm1 {k1}, zmm2, Element permute vector zmm3/mt using vec- 

36 /r zmm3/mt tor zmm2 as indices and store the final result in 
zmm1, under write-mask. 


Description 


Performs an element permutation of elements from int32 vector read from memory or 
vector zmm3, using int32 vector zmm2 element as source indices. The result of the per- 
mutation is written into int32 vector zmm1. Note that index values may be repeated so 
that the same vector source element can be replicated across many vector destination 
elements. 


No swizzle, broadcast, or conversion is performed by this instruction. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


src[511:0] = zmm3/m; 


for (n = 0; n < 16; n++) { 
if (ki[n] != 0) f 
i = 32*n 


j = zmm2[i+3:i] *32 
zmm1[i+31:i] = src[j+31:j] 
} 
} 
Flags Affected 
None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_permutevar_epi32 (_m512i,__m512i); 
—m512i _mm512_mask_permutevar_epi32 (_m512i,_mmask16,_m512i,_m512i); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 

This instruction does not support any 

SwizzUpConv different from the default value (no broadcast, 
no conversion). If SwizzUpConv function is set to any value 
different than "no action", then an Invalid Opcode fault is 
raised. This includes register swizzles. 
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VPERMF32X4 - Shuffle Vector Dqwords 


Opcode Instruction Description 

MVEX.512.66.0F3A.W0 07 /rib» vpermf32x4 zmm1 {k1},zmm2/m,,imm8 4xFloat32 shuffle element 
vector zmm2/m; and store 
the result in zmm1, using 
imm68 , under write-mask. 


Description 


Shuffles 128-bit blocks of the vector read from memory or vector zmm2/mem using index 
bits in immediate. The result of the shuffle is written into vector zmm1. 


No swizzle, broadcast, or conversion is performed by this instruction. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Immediate Format 


imm8 | 128-bit level permutation vector {3210} | I7 Ig | J5 In] Is In| lh, Ip 


Operation 


src[511:0] = zmm2/m; 


// Inter-lane shuffle 

for (n = 0; n < 16/4; n++) f{ 
i = 128*n 
j = 128*((perm128 >> 2*n) & 0x3) 
tmp [it+127:i] = src[j+127:j] 

} 


// Writemasking 
for (n = 0; n < 16; n++) f{ 
if (kifm] !=0) f 
zmm1[i+31:i] = tmp[it+31:i] 
} 
} 


482 Reference Number: 327364-001 


(intel 
CHAPTER 6. INSTRUCTION DESCRIPTIONS 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_permute4f128_epi32 (_m512i,_MM_PERM_ENUM); 

_—m512i _mm512_mask_permute4f128_epi32 (_m512i, —_mmask16, _m512i, 
_MM_PERM_ENUM); 

_—m512 _mm512_permute4f128_ps (_m512,_MM_PERM_ENUM); 

_—m512 _mm512_mask_permute4f128_ps (_m512, —_mmask16, _m512, 
_MM_PERM_ENUM); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 

This instruction does not support any 

SwizzUpConv different from the default value (no broadcast, 
no conversion). If SwizzUpConv function is set to any value 
different than "no action", then an Invalid Opcode fault is 
raised. This includes register swizzles. 
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VPGATHERDD - Gather Int32 Vector With Signed Dword Indices 
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Opcode Instruction Description 
MVEX.512.66.0F38.WO 90 vpgatherdd zmmz1 {k1}, Ui32(mv;z) Gather int32 vector Ujzo(mvu;) into int32 vec- 
/r /vsib tor zmm1 using doubleword indices and k1 as 


completion mask. 


Description 


A set of 16 memory locations pointed by base address BAS E_ADDR and doubleword 
index vector VIN DEX with scale SCALE are converted to a int32 vector. The result is 
written into int32 vector zmm1. 


Note the special mask behavior as only a subset of the active elements of write mask k1 
are actually operated on (as denoted by function SELECT_SUBSET). There are only 
two guarantees about the function: (a) the destination mask is a subset of the source mask 
(identity is included), and (b) on a given invocation of the instruction, at least one element 
(the least significant enabled mask bit) will be selected from the source mask. 


Programmers should always enforce the execution of a gather/scatter instruction to be 
re-executed (via a loop) until the full completion of the sequence (i.e. all elements of the 
gather/scatter sequence have been loaded/stored and hence, the write-mask bits all are 
zero). 


Note that accessed element by will always access 64 bytes of memory. The memory region 
accessed by each element will always be between elemen_linear_address & (~0x3F) and 
(element_linear_address & (~0x3F)) + 63 boundaries. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Note also the special mask behavior as the corresponding bits in write mask k1 are reset 
with each destination element being updated according to the subset of write mask k1. 
This is useful to allow conditional re-trigger of the instruction until all the elements from 
a given write mask have been successfully loaded. 


The instruction will #GP fault if the destination vector zmm1 is the same as index vector 
VINDEX. 


Operation 


// instruction works over a subset of the write mask 
ktemp = SELECT_SUBSET(k1) 


// Use mu, as vector memory operand (VSIB) 
for (n = 0; n < 16; n++) f{ 


if (ktemp[n] != 0) { 
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i = 32*n 

// mu;,[n] = BASE_ADDR + SignExtend(VINDEX[i+31:i] * SCALE) 
pointer [63:0] = mv; [n] 

zmm1[i+31:i] = UpConvLoadj32 (pointer) 

kifn] = 0 


Flags Affected 


None. 


Memory Up-conversion: U;35 


S2515S9 || Function: Usage disp8*N 
000 no conversion [rax] 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 1 

101 sint8 to sint32 [rax] {sint8} 1 

110 uint16 to uint32 [rax] {uint16} 2 

111 sint16 to sint32 [rax] {sint16} 2 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_i32gather_epi32 (_m512i, void const’, int); 

—m512i _mm512_mask_i32gather_epi32 (_m512i, _mmask16, _m512i, void const*, 
int); 

_—m512i _mm512_i32extgather_epi32 (_m512i, void const*, MM_UPCONV_EPI32_ENUM, 
int, int); 

—m512i _mm512_mask_i32extgather_epi32 (_m512i,__mmask16, _m512i, void const*, 
_MM_UPCONV_EPI32_ENUM, int, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 
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#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form, and corresponding write-mask bit is not zero. 
#GP(0) If a memory address is in a non-canonical form, 


and corresponding write-mask bit is not zero. 

If a memory operand linear address is not aligned 

to element-wise data granularity dictated by the UpConv 
and corresponding write-mask bit is not zero. 

If the destination vector is the same as the index vector [see 


#PF(fault-code) If a memory operand linear address produces a page fault 
and corresponding write-mask bit is not zero. 
#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If using a 16 bit effective address. 
If ModRM.rm is different than 100b. 
If no write mask is provided or selected write-mask is k0. 
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VPGATHERDQ - Gather Int64 Vector With Signed Dword Indices 


Opcode Instruction Description 

MVEX.512.66.0F38.W1 90 vpgatherdqzmm1 {k1}, Uig4(mv;z) Gather int64 vector Uiga(mv;z) into int64 vec- 

/r /vsib tor zmm1 using doubleword indices and k1 as 
completion mask. 


Description 


A set of 8 memory locations pointed by base address BASE_ADDR and doubleword 
index vector VIN DEX with scale SCALE are converted to a int64 vector. The result is 
written into int64 vector zmm1. 


Note the special mask behavior as only a subset of the active elements of write mask k1 
are actually operated on (as denoted by function SELECT_SUBSET). There are only 
two guarantees about the function: (a) the destination mask is a subset of the source mask 
(identity is included), and (b) on a given invocation of the instruction, at least one element 
(the least significant enabled mask bit) will be selected from the source mask. 


Programmers should always enforce the execution of a gather/scatter instruction to be 
re-executed (via a loop) until the full completion of the sequence (i.e. all elements of the 
gather/scatter sequence have been loaded/stored and hence, the write-mask bits all are 
zero). 


Note that accessed element by will always access 64 bytes of memory. The memory region 
accessed by each element will always be between elemen_linear_address & (~0x3F) and 
(element_linear_address & (~0x3F)) + 63 boundaries. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Note also the special mask behavior as the corresponding bits in write mask k1 are reset 
with each destination element being updated according to the subset of write mask k1. 
This is useful to allow conditional re-trigger of the instruction until all the elements from 
a given write mask have been successfully loaded. 


The instruction will #GP fault if the destination vector zmm1 is the same as index vector 
VINDEX. 


Operation 


// instruction works over a subset of the write mask 
ktemp = SELECT_SUBSET(k1) 


// Use mv, as vector memory operand (VSIB) 
for (n = 0; n < 8; nt++) f{ 


if (ktemp[n] != 0) { 
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i = 64*n 
j = 32+*n 
// mu;,[n] = BASE_ADDR + SignExtend(VINDEX[j+31:j] * SCALE) 
pointer [63:0] = mv; [n] 
zmm1[i+63:i] = UpConvLoadjg4 (pointer) 
kifn] = 0 
} 
} 
k1[15:8] = 0 


Flags Affected 


None. 


Memory Up-conversion: Uj¢4 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] 8 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_i32logather_epi64 (_m512i, void const*, int); 

—m512i _mm512_mask_i32logather_epi64 (_m512i, _mmask8, _m512i, void const*, 
int); 

_—m512i _mm512_i32loextgather_epi64 (_m512i, void const*, 
_MM_UPCONV_EPI64_ENUM, int, int); 

—m512i _mm512_mask_i32loextgather_epi64 (_m512i,__mmask8, _m512i, void const*, 
_MM_UPCONV_EPI64_ENUM, int, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 
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Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form, and corresponding write-mask bit is not zero. 
#GP(0) If a memory address is in a non-canonical form, 


and corresponding write-mask bit is not zero. 

If a memory operand linear address is not aligned 

to element-wise data granularity dictated by the UpConv 
and corresponding write-mask bit is not zero. 

If the destination vector is the same as the index vector [see 


#PF(fault-code) If a memory operand linear address produces a page fault 
and corresponding write-mask bit is not zero. 
#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If using a 16 bit effective address. 
If ModRM.rm is different than 100b. 
If no write mask is provided or selected write-mask is k0. 
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VPMADD231D - Multiply First Source By Second Source and Add To Des- 
tination Int32 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.W0 B5 /r vpmadd231d zmm1 {k1}, zmm2, S;32(zmm3/m:) Multiply int32 
vector zmm2 
and int32 vector 
Sizo(zmm3/mz), 


add the result 
to int32 vector 
zmmi1, and store 
the final result 
in zmmi, under 
write-mask. 


Description 


Performs an element-by-element multiplication between int32 vector zmm2 and the 
int32 vector result of the swizzle/broadcast/conversion process on memory or vector 
int32 zmm3, then adds the result to int32 vector zmm1. The final sum is written into 
int32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
if(kifm] != 0) f 
i = 32*n 
// integer operation 
zmm1[i+31:i] = zmm2[i+31:i] * tmpSrc3[it+31:i] + zmm1[it+31:i] 
} 
} 


490 Reference Number: 327364-001 


(intel. 


CHAPTER 6. INSTRUCTION DESCRIPTIONS 


Flags Affected 


None. 


Memory Up-conversion: S;35 


S251So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S25S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i 
—m512i 


_—m512i 


Exceptions 


_mm512_fmadd_epi32 (_m512i,__m512i,__m512i); 


_mm512_mask_fmadd_epi32 (_m512i,__mmask16,__m512i, _m512i); 
_mm512_mask3_fmadd_epi32 (_m512i 


Real-Address Mode and Virtual-8086 


#UD 


i, 


Instruction not available in these modes 
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Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPMADD233D - Multiply First Source By Specially Swizzled Second Source 
and Add To Second Source Int32 Vectors 


Opcode 
MVEX.NDS.512.66.0F38.W0 B4 /r 


Instruction 
vpmadd233d zmm1 {k1}, zmm2, S;30(zmm3/m:) 


Description 
Multiply int32 
vector zmm2_ by 
certain elements 
of int32 vector 
Si32(zmm3/mz:), 
add the re- 
sult to certain 
elements of 
Sizo(zmm3/mz), 
and store the final 
result in zmm1, 
under write-mask. 


Description 


This instruction is built around the concept of 4-element sets, of which there are four: 
elements 0-3, 4-7, 8-11, and 12-15. If we refer to the int32 vector result of the broadcast 
(no conversion is supported) process on memory or the int32 vector zmm3 (no swizzle 
is supported) as t3, then: 


Each element 0-3 of int32 vector zmm2 is multiplied by element 1 of t3, the result is added 
to element 0 of t3, and the final sum is written into the corresponding element 0-3 of int32 
vector zmm1. 


Each element 4-7 of int32 vector zmm2 is multiplied by element 5 of t3, the result is added 
to element 4 of t3, and the final sum is written into the corresponding element 4-7 of int32 
vector zmm1. 


Each element 8-11 of int32 vector zmm2 is multiplied by element 9 of t3, the result is 
added to element 8 of t3, and the final sum is written into the corresponding element 
8-11 of int32 vector zmm1. 


Each element 12-15 of int32 vector zmm2 is multiplied by element 13 of t3, the result is 
added to element 12 of t3, and the final sum is written into the corresponding element 
12-15 of int32 vector zmm1. 


This instruction makes it possible to perform scale and bias in a single instruction without 
needing to have either scale or bias already loaded in a register. This saves one vector load 
for each interpolant, representing around ten percent of shader instructions. 


For structure-of-arrays (SOA) operation, this instruction is intended to be used with the 
{4to16} broadcast on src2, allowing all 16 scale and biases to be identical. For array-of- 
structures (AOS) vec4 operations, no broadcast is used, allowing four different scales and 
biases, one for each vec4. 
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No conversion or swizzling is supported for this instruction. However, all broadcasts ex- 
cept {1to16} are supported (i.e. 16to16 and 4to16). 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj;39 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) { 
if (kifm] != 0) f 
i = 32*n 
base = ( n & ~0x03 ) * 32 
scale[31:0] = tmpSrc3[baset63: base+32] 
bias [31:0] = tmpSrc3[base+31: base] 
// integer operation 
zmm1[i+31:i] = zmm2[i+31:i] * scale[31:0] + bias[31:0] 


Flags Affected 


None. 


Memory Up-conversion: S;35 


$2519 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 reserved N/A N/A 
010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
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Register Swizzle: S;3. 


MVEX.EH=0 

S_5159 || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 reserved N/A 

010 reserved N/A 

011 reserved N/A 

100 reserved N/A 

101 reserved N/A 

110 reserved N/A 

111 reserved N/A 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_fmadd233_epi32 (_m512i,__m512i); 
—m512i _mm512_mask_fmadd233_epi32 (_m512i,_mmask16,__m512i,_m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to 16 or 64-byte (depending on the swizzle broadcast). 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
This instruction does not support any 
SwizzUpConv involving data conversion, register swizzling or 
{1to16} broadcast. If SwizzUpConv function is set to any 
value different than "no action" or {4to16} then 
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an Invalid Opcode fault is raised 
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VPMAXSD - Maximum of Int32 Vectors 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.WO vpmaxsd zmm1 {k1}, zmm2, Determine the maximum of int32 vector zmm2 
3D /r Sizo(zmm3/mz) and int32 vector S;32(zmm3/m,) and store the 


result in zmm1, under write-mask. 


Description 


Determines the maximum value of each pair of corresponding elements in int32 vector 
zmm_2 and the int32 vector result of the swizzle/broadcast/conversion process on mem- 
ory or int32 vector zmm3. The result is written into int32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoad;39 (zmm3/m;,) 

} 


for (n = 0; n < 16; n++) { 
a2 Gein] t=) 4 
i = 32*n 
// signed integer operation 
zmm1[i+31:i] = IMax(zmm2[i+31:i] , tmpSrc3[i+31:i]) 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_max_epi32 (_m512i,_m512i); 
_—m512i _mm512_mask_max_epi32 (_m512i,_mmask16,__m512i,_m512i); 


| 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPMAXUD - Maximum of Uint32 Vectors 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.WO vpmaxud zmm1 {k1}, zmm2, Determine the maximum of uint32 vector 
3F /r Sizo(zmm3/mz) zmmz2 and uint32 vector S;32(zmm3/m:) and 


store the result in zmm1, under write-mask. 


Description 


Determines the maximum value of each pair of corresponding elements in uint32 vec- 
tor zmm2 and the uint32 vector result of the swizzle/broadcast/conversion process on 
memory or uint32 vector zmm3. The result is written into uint32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoad;39 (zmm3/m;,) 

} 


for (n = 0; n < 16; n++) f{ 
if Gc [a] != 0) 4 
i = 32*n 
// unsigned integer operation 
zmm1[i+31:i] = UMax(zmm2[i+31:i] , tmpSrc3[i+31:i]) 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_max_epu32 (_m512i,_m512i); 
_—m512i _mm512_mask_max_epu32 (_m512i,_mmask16,__m512i,_m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPMINSD - Minimum of Int32 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.WO vpminsd zmm1 {k1}, zmm2, Determine the minimum of int32 vector zmm2 

39 /r Sizo(zmm3/mz) and int32 vector S;32(zmm3/m,) and store the 
result in zmm1, under write-mask. 


Description 


Determines the minimum value of each pair of corresponding elements in int32 vector 
zmm_2 and the int32 vector result of the swizzle/broadcast/conversion process on mem- 
ory or int32 vector zmm3. The result is written into int32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
if(kilm] != 0) { 
i = 32*n 
// signed integer operation 
zmm1[i+31:i] = (zmm2[i+31:i] < tmpSrc3[i+31:i]) ? 
zmm2(i+31:i] : tmpSrc3[i+31:i] 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_min_epi32 (_m512i,_m512i); 


—m512i _mm512_mask_min_epi32 (_m512i,_mmask16,__m512i,__m512i); 


— 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPMINUD - Minimum of Uint32 Vectors 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.WO vpminud zmm1 {k1}, zmm2, Determine the minimum of uint32 vector 
3B /r Sizo(zmm3/mz) zmmz2 and uint32 vector S;32(zmm3/m:) and 


store the result in zmm1, under write-mask. 


Description 


Determines the minimum value of each pair of corresponding elements in uint32 vector 
zmm_2 and the uint32 vector result of the swizzle/broadcast/conversion process on mem- 
ory or uint32 vector zmm3. The result is written into uint32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoad;39 (zmm3/m;,) 

} 


for (n = 0; n < 16; n++) f{ 
if Gc [a] != 0) 4 
i = 32*n 
// unsigned integer operation 
zmm1[i+31:i] = UMin(zmm2([i+31:i] , tmpSrc3[i+31:i]) 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_min_epu32 (_m512i,__m512i); 
_—m512i _mm512_mask_min_epu32 (_m512i,__mmask16,_m512i,__m512i); 


,—— 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPMULHD - Multiply Int32 Vectors And Store High Result 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.WO vpmulhd zmm1 {k1}, zmm2, Multiply int32 vector zmm2 and int32 vector 

87 /r Sizo(zmm3/mz) Sizo(zmm3/m;,) and store the result in zmm1, 
under write-mask. 


Description 


Performs an element-by-element multiplication between int32 vector zmm2 and the 
int32 vector result of the swizzle/broadcast/conversion process on memory or int32 vec- 
tor zmm3. The high 32 bits of the result are written into int32 zmm1 vector. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

I: 


for (n = 0; n < 16; n++) f{ 
if(ki[n] != 0) { 
i = 32*n 
// signed integer operation 
tmp([63:0] = zmm2[it31:i] * tmpSrc3[it31:i] 
zmm1[i+31:i] = tmp[63:32] 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_mulhi_epi32 (_m512i,_m512i); 


—m512i _mm512_mask_mulhi_epi32 (_m512i,__mmask16,__m512i, _m512i); 


i— 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 


510 Reference Number: 327364-001 


= 
=r 
é 


CHAPTER 6. INSTRUCTION DESCRIPTIONS 


#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPMULHUD - Multiply Uint32 Vectors And Store High Result 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.WO vpmulhud zmm1 {k1}, zmm2, Multiply uint32 vector zmm2 and uint32 vector 

86 /r Sizo(zmm3/mz) Sizo(zmm3/m;,) and store the result in zmm1, 
under write-mask. 


Description 


Performs an element-by-element multiplication between uint32 vector zmm2 and the 
uint32 vector result of the swizzle/broadcast/conversion process on memory or uint32 
vector zmm3. The high 32 bits of the result are written into uint32 zmm1 vector. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) { 
if(ki[n] != 0) { 
i = 32*n 
// unsigned integer operation 
tmp(63:0] = zmm2[it31:i] * tmpSrc3[it31:i] 
zmm1[i+31:i] = tmp[63:32] 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


| 


—m512i _mm512_mulhi_epu32 (_m512i,__m512i); 
—m512i _mm512_mask_mulhi_epu32 (_m512i 
Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Protected and Compatibility Mode 


#UD 


64 bit Mode 


Reference Number: 327364-001 


Instruction not available in these modes 


Instruction not available in these modes 


mmask16, _m512i,__m512i); 
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#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPMULLD - Multiply Int32 Vectors And Store Low Result 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.WO vpmulld zmm1 {k1}, zmm2, Multiply int32 vector zmm2 and int32 vector 

40 /r Si32(zmm3/m;) Si32(zmm3/m,) and store the result in zmm1, 
under write-mask. 


Description 


Performs an element-by-element multiplication between int32 vector zmm2 and the 
int32 vector result of the swizzle/broadcast/conversion process on memory or int32 vec- 
tor zmm3, and the low 32 bits of the result are written into int32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
if(ki [a] I= 0) 4 
i = 32*n 
// signed integer operation 
zmm1[i+31:i] = zmm2[i+31:i] * tmpSrc3[it31:i] 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_mullo_epi32 (_m512i,_m512i); 
—m512i _mm512_mask_mullo_epi32 (_m512i,_mmask16,__m512i,_m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPORD - Bitwise OR Int32 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F.W0O vpord zmmi_ {ki}, zmm2, Perform a bitwise OR between int32 vector 

EB /r Sizo(zmm3/mz) zmm_2 and int32 vector 5;32(zmm3/m;) and 
store the result in zmm1, under write-mask. 


Description 


Performs an element-by-element bitwise OR between int32 vector zmm2 and the int32 
vector result of the swizzle/broadcast/conversion process on memory or int32 vector 
zmm3. The result is written into int32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
if(ki[n] != 0) { 
i = 32*n 
zmm1[i+31:i] = zmm2[i+31:i] | tmpSrc3[it31:i] 
} 
} 


Flags Affected 


None. 


518 Reference Number: 327364-001 


= 
2 


CHAPTER 6. INSTRUCTION DESCRIPTIONS 


Memory Up-conversion: S;35 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;3. 


MVEX.EH=0 

S25S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_or_epi32 (_m512i,__m512i); 
—m512i _mm512_mask_or_epi32 (_m512i,__mmask16,__m512i,_m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPORQ - Bitwise OR Int64 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0FW1 vporq zmmi_ {ki}, zmm2, Perform a bitwise OR between int64 vector 

EB /r Siga(zmm3/mz) zmm_2 and int64 vector Sjg4(zmm3/m;) and 
store the result in zmm1, under write-mask. 


Description 


Performs an element-by-element bitwise OR between int64 vector zmmz2 and the int64 
vector result of the swizzle/broadcast/conversion process on memory or int64 vector 
zmm3. The result is written into int64 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadjg4(zmm3/m;) 

} 


for (n = 0; n < 8; nt++) f{ 
if(ki[n] != 0) { 
i = 64*n 
zmm1[i+63:i] = zmm2[i+63:i] | tmpSrc3[it+63:i] 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;64 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Register Swizzle: Sig. 


MVEX.EH=0 

S2S1Spo || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_or_epi64 (_m512i,__m512i); 
—m512i _mm512_mask_or_epi64 (_m512i,_mmask8,__m512i,_m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPSBBD - Subtract Int32 Vectors with Borrow 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.WO vpsbbd zmmt1 _ {ki}, k2, Subtract int32 vector S;32(zmm3/m,) and vec- 
5E /r Sizo(zmm3/mz) tor mask register k2 from int32 vector zmm1 


and store the result in zmm1, and the borrow 
of the subtraction in k2, under write-mask. 


Description 


Performs an element-by-element three-input subtraction of the int32 vector result of the 
swizzle/broadcast/conversion process on memory or int32 vector zmm3, as well as the 
corresponding bit of k2, from int32 vector zmm1. The result is written into int32 vector 
zmm1. 


In addition, the borrow from the subtraction difference for the n-th element is written 
into the n-th bit of vector mask k2. 


This instruction is write-masked, so only those elements with the corresponding bit set in 
vector mask register k1 are computed and stored into zmm1 and k2. Elements in zmm1 
and k2 with the corresponding bit clear in k1 retain their previous value. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
ifGci [a] != 0) 4 
i = 32*n 
// integer operation 
tmpBorrow = Borrow(zmm1[it+31:i] - k2[n] - tmpSrc3[i+31:i]) 
zmm1[i+31:i] = zmmi[i+31:i] - k2[n] - tmpSrc3[i+31:i] 
k2[n] = tmpBorrow 
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Flags Affected 


None. 


Memory Up-conversion: S;35 


S251So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S25S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_sbb_epi32 (_m512i,__mmask16,__m512i,__mmask16*); 
—m512i _mm512_mask_sbb_epi32 (_m512i, _mmask16, _mmask16, _m512i, 
__mmask16*); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 
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Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPSBBRD - Reverse Subtract Int32 Vectors with Borrow 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.WO vpsbbrd zmm1_ {ki}, k2, Subtract int32 vector zmm1 and vector mask 
6E /r Sizo(zmm3/mz) register k2 from int32 vector S;30(zmm3/mz), 


and store the result in zmm1, and the borrow 
of the subtraction in k2, under write-mask. 


Description 


Performs an element-by-element three-input subtraction of int32 vector zmm1, as well as 
the corresponding bit of k2, from the int32 vector result of the swizzle/broadcast/conversion 
process on memory or int32 vector zmm3. The result is written into int32 vector zmm1. 


In addition, the borrow from the subtraction for the n-th element is written into the n-th 
bit of vector mask k2. 


This instruction is write-masked, so only those elements with the corresponding bit set in 
vector mask register k1 are computed and stored into zmm1 and k2. Elements in zmm1 
and k2 with the corresponding bit clear in k1 retain their previous value. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
if(ki[m] != 0) f 
i = 32*n 
// integer operation 
tmpBorrow = Borrow(tmpSrc3[i+31:i] - k2[n] - zmmi[i+31:i]) 
zmm1[i+31:i] = tmpSrc3[i+31:i] - k2[n) - zmm1[i+31:i] 
k2[n] = tmpBorrow 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S251So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S55S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_sbbr_epi32 (_m512i,__mmask16,_m512i,__mmask16*); 
_—m512i _mm512_mask_sbbr_epi32 (_m512i, _mmask16, _mmask16, _m512i, 
__mmask16*); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
#UD 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 


If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPSCATTERDD - Scatter Int32 Vector With Signed Dword Indices 


530 


Opcode Instruction Description 
MVEX.512.66.0F38.W0 AO vpscatterdd Muy {k1}, Scatter int32 vector Dj32(zmm1) to vector 
/r /vsib Dj32(zmm1) memory locations mv, using doubleword in- 


dices and k1 as completion mask. 


Description 


Down-converts and stores all 16 elements in int32 vector UNDEF to the memory locations 
pointed by base address BAS E_ADDR and doubleword index vector VIN DEX, with 
scale SCALE. 


Note the special mask behavior as only a subset of the active elements of write mask k1 
are actually operated on (as denoted by function SELECT_SUBSET). There are only 
two guarantees about the function: (a) the destination mask is a subset of the source mask 
(identity is included), and (b) on a given invocation of the instruction, at least one element 
(the least significant enabled mask bit) will be selected from the source mask. 


Programmers should always enforce the execution of a gather/scatter instruction to be 
re-executed (via a loop) until the full completion of the sequence (i.e. all elements of the 
gather/scatter sequence have been loaded/stored and hence, the write-mask bits all are 
zero). 


Writes to overlapping destination memory locations are guaranteed to be ordered with 
respect to each other (from LSB to MSB of the source registers). Only writes to overlapping 
vector indices are guaranteed to be ordered with respect to each other (from LSB to MSB 
of the source registers). Writes that are not overlapped may happen in any order. Memory 
ordering with other instructions follows the Intel-64 memory ordering model. Note that 
this does not account for non-overlapping indices that map into the same physical address 
locations. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element after down-conversion. 


Note also the special mask behavior as the corresponding bits in write mask k1 are reset 
with each destination element being updated according to the subset of write mask k1. 
This is useful to allow conditional re-trigger of the instruction until all the elements from 
a given write mask have been successfully stored. 


Operation 


// instruction works over a subset of the write mask 
ktemp = SELECT_SUBSET(k1) 


// Use muy, as vector memory operand (VSIB) 
for (n = 0; n < 16; n++) { 
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if (ktemp[n] != 0) { 
i = 32*n 
// mu;,{n] = BASE_ADDR + SignExtend(VINDEX[i+31:i] * SCALE) 
pointer [63:0] = mv; [n] 
tmp = DownConvStore;39 (UNDEF [i+31:i], SSS[2:0]) 
if (DownConvStoreSizeOf j32(SSS[2:0]) == 4) { 
MemStore(pointer) = tmp[31:0] 


} else if (DownConvStoreSizeOf j32(SSS[2:0]) == 2) { 
MemStore(pointer) = tmp[15:0] 
} else if (DownConvStoreSizeDf j;3.(SSS[2:0]) == 1) { 
MemStore(pointer) = tmp[7:0] 

} 

ki[n] = 0 
} 

} 
Flags Affected 
None. 
Memory Down-conversion: D;32 

S2515o || Function: Usage disp8*N 
000 no conversion zmm1 4 
001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 uint32 to uint8 zmm1 {uint8} 1 
101 sint32 to sint8 zmm1 {sint8} 1 
110 uint32 to uint16 zmm1 {uint16} 2 
111 sint32 to sint16 zmm1 {sint16} 2 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_i32scatter_epi32 (void*,__m512i, _m512i, int); 
void _mm512_mask_i32scatter_epi32 (void*,__mmask16,_m512i,__m512i, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 
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Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form, and corresponding write-mask bit is not zero. 
#GP(0) If a memory address is in a non-canonical form, 


and corresponding write-mask bit is not zero. 
If a memory operand linear address is not aligned 
to element-wise data granularity dictated by the DownConv 
mode, and corresponding write-mask bit is not zero. 
#PF(fault-code) If a memory operand linear address produces a page fault 
and corresponding write-mask bit is not zero. 
#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If using a 16 bit effective address. 
If ModRM.rm is different than 100b. 
If no write mask is provided or selected write-mask is k0. 
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VPSCATTERDQ - Scatter Int64 Vector With Signed Dword Indices 


Opcode Instruction Description 
MVEX.512.66.0F38.W1 AO vpscatterdq Muy {k1}, Scatter int64 vector Djg4(zmm1) to vector 
/r /vsib Diga(zmm1) memory locations mz, using doubleword in- 


dices and k1 as completion mask. 


Description 


Down-converts and stores all 8 elements in int64 vector UNDEF to the memory locations 
pointed by base address BAS E_ADDR and doubleword index vector VIN DEX, with 
scale SCALE. 


Note the special mask behavior as only a subset of the active elements of write mask k1 
are actually operated on (as denoted by function SELECT_SUBSET). There are only 
two guarantees about the function: (a) the destination mask is a subset of the source mask 
(identity is included), and (b) on a given invocation of the instruction, at least one element 
(the least significant enabled mask bit) will be selected from the source mask. 


Programmers should always enforce the execution of a gather/scatter instruction to be 
re-executed (via a loop) until the full completion of the sequence (i.e. all elements of the 
gather/scatter sequence have been loaded/stored and hence, the write-mask bits all are 
zero). 


Writes to overlapping destination memory locations are guaranteed to be ordered with 
respect to each other (from LSB to MSB of the source registers). Only writes to overlapping 
vector indices are guaranteed to be ordered with respect to each other (from LSB to MSB 
of the source registers). Writes that are not overlapped may happen in any order. Memory 
ordering with other instructions follows the Intel-64 memory ordering model. Note that 
this does not account for non-overlapping indices that map into the same physical address 
locations. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element after down-conversion. 


Note also the special mask behavior as the corresponding bits in write mask k1 are reset 
with each destination element being updated according to the subset of write mask k1. 
This is useful to allow conditional re-trigger of the instruction until all the elements from 
a given write mask have been successfully stored. 


Operation 


// instruction works over a subset of the write mask 
ktemp = SELECT_SUBSET(k1) 


// Use muy, as vector memory operand (VSIB) 
for (n = 0; n < 8; nt++) f{ 
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if (ktemp[n] != 0) { 
i = 64*n 
j = 32+*n 
// mvu,[n] = BASE_ADDR + SignExtend(VINDEX[j+31:j] * SCALE) 
pointer [63:0] = mv; [n] 
tmp = DownConvStorejg4 (UNDEF [1+63:i], SSS[2:0]) 
if (DownConvStoreSize0f jg4(SSS[2:0]) == 8) { 
MemStore(pointer) = tmp[63:0] 
} 
kifn] = 0 
F 
} 
k1[15:8] = 0 


Flags Affected 


None. 


Memory Down-conversion: Dj¢4 


S2515S9 || Function: Usage disp8*N 
000 no conversion zmm1 8 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_i32loscatter_epi64 (void*, _m512i,__m512i, int); 
void _mm512_mask_i32loscatter_epi64 (void*,_mmask8,_m512i,__m512i, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 
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Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form, and corresponding write-mask bit is not zero. 
#GP(0) If a memory address is in a non-canonical form, 


and corresponding write-mask bit is not zero. 
If a memory operand linear address is not aligned 
to element-wise data granularity dictated by the DownConv 
mode, and corresponding write-mask bit is not zero. 
#PF(fault-code) If a memory operand linear address produces a page fault 
and corresponding write-mask bit is not zero. 
#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If using a 16 bit effective address. 
If ModRM.rm is different than 100b. 
If no write mask is provided or selected write-mask is k0. 
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VPSHUFD - Shuffle Vector Doublewords 


Opcode Instruction 


MVEX.512.66.0R WO 70 /r ib 


vpshufd zmm1 {k1}, zmm2/m;, imm8 


Description 
Dword shuffle int32 vector 
zmm2/m, and store the result 
in zmmi1, using imm8 , under 
write-mask. 


Description 


Shuffles 32 bit blocks of the vector read from memory or vector zmm2/mem using index 
bits in immediate. The result of the shuffle is written into vector zmm1. 


No swizzle, broadcast, or conversion is performed by this instruction. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 


the corresponding bit clear in k1 retain their previous values. 


Immediate Format 


imm8 | 32 bit level permutation vector {dcba} | [7 JIg | I5 In|] Is In| lh Ip 
Operation 
src[511:0] = zmm2/m, 


// Intra-lane shuffle 


for (n = 0; n < 16; n++) { 
if (kifm] !=0) { 
i = 32*n 


// offset within 128-bit chunk 

j = 32*((perm32 >> 2*(n & 0x3)) & 0x3) 
// 128-bit level offset 

j = j + 128*(n >> 2) 

zmm1[i+31:i] = src[jt+31:j] 
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Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_shuffle_epi32 (_m512i, MM_PERM_ENUM); 


—m512i _mm512_mask_shuffle_epi32 (_m512i, _mmask16, _m512i, 


_MM_PERM_ENUM); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 

This instruction does not support any 

SwizzUpConv different from the default value (no broadcast, 
no conversion). If SwizzUpConv function is set to any value 
different than "no action", then an Invalid Opcode fault is 
raised. This includes register swizzles. 
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VPSLLD - Shift Int32 Vector Immediate Left Logical 


Opcode Instruction Description 
MVEX.NDD.512.66.0F.W0 vpslld zmm1 {k1}, Shiftleftint32 vector S;32(zmm2/m,) and store 
72 /6ib Sizo(zmm2/mz), 7mms the result in zmm1, using 7mm8, under write- 
mask. 
Description 


Performs an element-by-element logical left shift of the result of the swizzle/broadcast/conversion 
process on memory or vector int32 zmm2, shifting by the number of bits specified in im- 
mediate field. The result is stored in int32 vector zmm1. 


If the value specified by the shift operand is greater than 31 then the destination operand 
is set to all Os. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 
tmpSrc2[511:0] = zmm2[511:0] 

} else f{ 
tmpSrc2[511:0] = SwizzUpConvLoadj32 (zmm2/m;,) 

} 


for (n = 0; n < 16; n++) f{ 
ifGcd [a] = 0) 4 
i = 32*n 
// integer operation 
zmm1[i+31:i] = tmpSrc2[i+31:i] << IMM8[7:0] 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_slli_epi32 (_m512i, unsigned int); 
—m512i _mm512_mask_slli_epi32 (_m512i,_mmask16, _m512i, unsigned int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPSLLVD - Shift Int32 Vector Left Logical 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.WO vpsllvd zmm1 {kl}, zmmz2, Shift left int32 vector zmm2 and int32 vector 

47 /r Sizo(zmm3/mz) Si3o(zmm3/m;) and store the result in zmm1, 
under write-mask. 


Description 


Performs an element-by-element left shift of int32 vector zmm2, shifting by the number 
of bits specified by the int32 vector result of the swizzle/broadcast/conversion process 
on memory or vector int32 zmm3. The result is stored in int32 vector zmm1. 


If the value specified by the shift operand is greater than 31 then the destination operand 
is set to all Os. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 
tmpSrc3[511:0] = zmm3[511:0] 

} else f{ 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
ifGcdi [a] 1 0) 4 
i = 32*n 
// signed integer operation 
zmm1[i+31:i] = zmm2[i+31:i] << tmpSrc3[i+31:i] 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i 
_—m512i 


Exceptions 


_mm512_sllv_epi32 (_m512i,_m512i); 


_mm512_mask_sllv_epi32 (_m512i,__mmask16,__m512i,_m512i); 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
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Instruction not available in these modes 
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#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPSRAD - Shift Int32 Vector Immediate Right Arithmetic 


Opcode Instruction Description 

MVEX.NDD.512.66.0F.W0 vpsrad zmm1 {k1}, Shift right arithmetic int32 vector 

72 /4 ib Sizo(zmm2/mz), 7mms Si32(zmm2/m;) and store the result in zmm1, 
using 7mmé8, under write-mask. 


Description 


Performs an element-by-element arithmetic right shift of the result of the swizzle/broadcast/conversion 
process on memory or vector int32 zmm2, shifting by the number of bits specified in im- 
mediate field. The result is stored in int32 vector zmm1. 


An arithmetic right shift leaves the sign bit unchanged after each shift count, so the final 
result has the 7+1 msbs set to the original sign bit, where 7 is the number of bits by which 
to shift right. 


If the value specified by the shift operand is greater than 31 each destination data element 
is filled with the initial value of the sign bit of the element. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 
tmpSrc2[511:0] = zmm2[511:0] 

} else { 
tmpSrc2[511:0] = SwizzUpConvLoadj;39 (zmm2/m,) 

} 


for (n = 0; n < 16; n++) f{ 
if(kl[n} j= 0) 4 
i = 32*n 
// signed integer operation 
zmm1[i+31:i] = tmpSrc2[i+31:i] >> IMM8[7:0] 
F 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_srai_epi32 (_m512i, unsigned int); 
—m512i _mm512_mask_srai_epi32 (_m512i,_mmask16,__m512i, unsigned int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPSRAVD - Shift Int32 Vector Right Arithmetic 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.WO vpsravd zmmi {ki}, zmm2, Shift right arithmetic int32 vector zmm2 and 

46 /r Sizo(zmm3/mz) int32 vector S;32(zmm3/m;) and store the re- 
sult in zmm1, under write-mask. 


Description 


Performs an element-by-element arithmetic right shift of int32 vector zmm2, shifting by 
the number of bits specified by the int32 vector result of the swizzle/broadcast/conversion 
process on memory or vector int32 zmm3. The result is stored in int32 vector zmm1. 


An arithmetic right shift leaves the sign bit unchanged after each shift count, so the final 
result has the 7+1 msbs set to the original sign bit, where 7 is the number of bits by which 
to shift right. 


If the value specified by the shift operand is greater than 31 each destination data element 
is filled with the initial value of the sign bit of the element. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj;39 (zmm3/m;,) 

} 


for (n = 0; n < 16; n++) f{ 
if(kifn] != 0) { 
i = 32*n 
// signed integer operation 
zmm1[i+31:i] = zmm2[i+31:i] >> tmpSrc3[i+31:i] 
F 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_srav_epi32 (_m512i,__m512i); 
_—m512i _mm512_mask_srav_epi32 (_m512i,_mmask16,__m512i,__m512i); 


| re 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPSRLD - Shift Int32 Vector Immediate Right Logical 


550 


Opcode Instruction Description 
MVEX.NDD.512.66.0F.W0 vpsrld zmm1 {k1}, Shift right logical int32 vector S;32(zmm2/m) 
72 /2 ib Sizo(zmm2/m,), 7mms and store the result in zmm1, using 7mm8, un- 


der write-mask. 


Description 


Performs an element-by-element logical right shift of the result of the swizzle/broadcast/conversion 
process on memory or vector int32 zmm2, shifting by the number of bits specified in im- 
mediate field. The result is stored in int32 vector zmm1. 


A logical right shift shifts a 0-bit into the msb for each shift count, so the final result has 
the 2 msbs set to 0, where 7 is the number of bits by which to shift right. 


If the value specified by the shift operand is greater than 31 then the destination operand 
is set to all Os. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc2[511:0] = zmm2[511:0] 

} else { 
tmpSrc2[511:0] = SwizzUpConvLoadj32 (zmm2/m;) 

} 


for (n = 0; n < 16; n++) f{ 
ae Get [af = 0)" 
i = 32*n 
// signed integer operation 
zmm1[i+31:i] = tmpSrc2[i+31:i] >> IMM8[7:0] 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_srli_epi32 (_m512i, unsigned int); 
—m512i _mm512_mask_srli_epi32 (_m512i,__mmask16, _m512i, unsigned int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPSRLVD - Shift Int32 Vector Right Logical 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.WO vpsrlvd zmm1 {ki}, zmm2, Shift right logical int32 vector zmm2 and int32 

45 /r Si32(zmm3/m,) vector 5;32(zmm3/m,) and store the result in 
zmm1, under write-mask. 


Description 


Performs an element-by-element logical right shift of int32 vector zmm2, shifting by the 
number of bits specified by the int32 vector result of the swizzle/broadcast/conversion 
process on memory or vector int32 zmm3. The result is stored in int32 vector zmm1. 


A logical right shift shifts a 0-bit into the msb for each shift count, so the final result has 
the 2 msbs set to 0, where 7 is the number of bits by which to shift right. 


If the value specified by the shift operand is greater than 31 then the destination operand 
is set to all Os. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
ae Get [af = 0)" 
i = 32*n 
// signed integer operation 
zmm1[i+31:i] = zmm2[i+31:i] >> tmpSrc3[i+31:i] 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_srlv_epi32 (_m512i,_m512i); 
—m512i _mm512_mask_srlv_epi32 (_m512i,_ mmask16,__m512i,__m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPSUBD - Subtract Int32 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F.W0 vpsubd zmm1 {ki}, zmm2, Subtract int32 vector Sj;32.(zmm3/m,) from 

FA /r Si32(zmm3/m;) int32 vector zmm2 and store the result in 
zmm1, under write-mask. 


Description 


Performs an element-by-element subtraction from int32 vector zmm2 of the int32 vector 
result of the swizzle/broadcast/conversion process on memory or int32 vector zmm3. 
The result is written into int32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
ie tki [a]: I= 0). 4 
i = 32*n 
// integer operation 
zmm1[i+31:i] = zmm2[i+31:i] - tmpSrc3[it+31:i] 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_sub_epi32 (_m512i,__m512i); 
—m512i _mm512_mask_sub_epi32 (_m512i,__mmask16, __ 
Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPSUBRD - Reverse Subtract Int32 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.WO vpsubrd zmm1 {k1}, zmm2, Subtract int32 vector zmm2 from int32 vector 

6C /r Si32(zmm3/m,) Si32(zmm3/m,) and store the result in zmm1, 
under write-mask. 


Description 


Performs an element-by-element subtraction of int32 vector zmm2 from the int32 vector 
result of the swizzle/broadcast/conversion process on memory or int32 vector zmm3. 
The result is written into int32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
ie tki [a]: I= 0). 4 
i = 32*n 
// integer operation 
zmm1[i+31:i] = -zmm2([i+31:i] + tmpSrc3[i+31:i] 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i _mm512_subr_epi32 (_m512i,__m512i); 
_—m512i _mm512_mask_subr_epi32 (_m512i,__mmask16,__m512i,__m512i); 


—— 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPSUBRSETBD - Reverse Subtract Int32 Vectors and Set Borrow 
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Opcode Instruction Description 
MVEX.NDS.512.66.0F38.WO vpsubrsetbd zmm1 {k1}, k2, Subtract int32 vector zmm1 from int32 vector 
6F /r Si32(zmm3/m,) Si32(zmm3/m,) and store the subtraction in 


zmm1 and the borrow from the subtraction in 
k2, under write-mask. 


Description 


Performs an element-by-element subtraction of int32 vector zmm1 from the int32 vector 
result of the swizzle/broadcast/conversion process on memory or int32 vector zmm3. 
The result is written into int32 vector zmm1. 


In addition, the borrow from the subtraction for the n-th element is written into the n-th 
bit of vector mask k2. 


This instruction is write-masked, so only those elements with the corresponding bit set in 
vector mask register k1 are computed and stored into zmm1 and k2. Elements in zmm1 
and k2 with the corresponding bit clear in k1 retain their previous value. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj;39 (zmm3/m;,) 

} 


for (n = 0; n < 16; n++) f{ 
if(ki[n] != 0) 4 
i = 32*n 
// integer operation 
k2[n] = Borrow(tmpSrc3[i+31:i] - zmmi[it+31:i]) 
zmm1[i+31:i] = tmpSrc3[i+31:i] - zmm1[it+31:i] 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S251So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S55S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_subrsetb_epi32 (_m512i,__m512i,__mmask16*); 
_—m512i _mm512_mask_subrsetb_epi32 (_m512i, _mmask16, _mmask16, _m512i, 
__mmask16*); 
Exceptions 


Real-Address Mode and Virtual-8086 
#UD Instruction not available in these modes 
Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 
mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 
#UD If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPSUBSETBD - Subtract Int32 Vectors and Set Borrow 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.W0 vpsubsetbd zmmi_ {kl}, k2, Subtract int32 vector Sj32.(zmm3/m:) from 
5F /r Si32(zmm3/m,) int32 vector zmm1 and store the subtraction in 


zmm1 and the borrow from the subtraction in 
k2, under write-mask. 


Description 


Performs an element-by-element subtraction of the int32 vector result of the swiz- 
zle/broadcast/conversion process on memory or int32 vector zmm3 from int32 vector 
zmm1. The result is written into int32 vector zmm1. 


In addition, the borrow from the subtraction for the n-th element is written into the n-th 
bit of vector mask k2. 


This instruction is write-masked, so only those elements with the corresponding bit set in 
vector mask register k1 are computed and stored into zmm1 and k2. Elements in zmm1 
and k2 with the corresponding bit clear in k1 retain their previous value. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) { 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj;39 (zmm3/m;,) 

} 


for (n = 0; n < 16; n++) f{ 
if(ki[n] != 0) 4 
i = 32*n 
// integer operation 
k2[n] = Borrow(zmmi[i+31:i] - tmpSrc3[i+31:i]) 
zmm1[i+31:i] = zmmi[i+31:i] - tmpSrc3[it31:i] 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S251So || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S55S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_subsetb_epi32 (_m512i,_m512i,__mmask16*); 
_—m512i _mm512_mask_subsetb_epi32 (_m512i, _mmask16, _mmask16, _m512i, 
__mmask16*); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
#UD 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 


If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPTESTMD - Logical AND Int32 Vectors and Set Vector Mask 
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Opcode Instruction Description 
MVEX.NDS.512.66.0F38.WO vptestmd k2 {kl}, zmmt1, Perform a bitwise AND between int32 vector 
27 /r Sizo(zmm2/mz) zmm1 and int32 vector Sj32(zmm2/m,), and 


set vector mask k2 to reflect the zero/non- 
zero status of each element of the result, under 
write-mask. 


Description 


Performs an element-by-element bitwise AND between int32 vector zmm1 and the int32 
vector result of the swizzle/broadcast/conversion process on memory or int32 vector 
zmm_2, and uses the result to construct a 16 bit vector mask, with a 0-bit for each element 
for which the result of the AND was 0, and a 1-bit where the result of the AND was not 
zero. The final result is written into vector mask k2. 


The write-mask does not perform the normal write-masking function for this instruction. 
While it does enable/disable comparisons, it does not block updating of the destination; 
instead, if a write-mask bit is 0, the corresponding destination bit is set to 0. Nonethe- 
less, the operation is similar enough so that it makes sense to use the usual write-mask 
notation. This mode of operation is desirable because the result will be used directly as a 
write-mask, rather than the normal case where the result is used with a separate write- 
mask that keeps the masked elements inactive. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc2[511:0] = zmm2[511:0] 

} else f{ 
tmpSrc2[511:0] = SwizzUpConvLoadj32 (zmm2/m;) 


} 
for (n = 0; n < 16; n++) { 
k2[n] = 0 
if(ki[n] != 0) { 
i = 32*n 


// signed integer operation 
if ((zmmi[i+31:i] & tmpSrc2[i+31:i]) != 0) f{ 
k2[n] = 1 
} 
} 
} 
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Flags Affected 


None. 


Memory Up-conversion: S;35 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;3. 


MVEX.EH=0 

S255 || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_mmask16 _mm512_test_epi32_mask (_m512i,__m512i); 
_mmask16 _mm512_mask_test_epi32_mask (_mmask16,__m512i,_m512i); 
Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 
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#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


570 


Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPXORD - Bitwise XOR Int32 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F.W0O vpxord zmm1 {kl}, zmm2, Perform a bitwise XOR between int32 vector 

EF /r Si32(zmm3/m;) zmm_2 and int32 vector S;32(zmm3/m,) and 
store the result in zmm1, under write-mask. 


Description 


Performs an element-by-element bitwise XOR between int32 vector zmm2 and the int32 
vector result of the swizzle/broadcast/conversion process on memory or int32 vector 
zmm3. The result is written into int32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadj32 (zmm3/m;) 

} 


for (n = 0; n < 16; n++) f{ 
if(ki [a] I= 0) 4 
i = 32*n 
// signed integer operation 
zmm1[i+31:i] = zmm2[i+31:i] ~ tmpSrc3[it+31:i] 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 reserved N/A N/A 
100 uint8 to uint32 [rax] {uint8} 16 

101 sint8 to sint32 [rax] {sint8} 16 

110 uint16 to uint32 [rax] {uint16} 32 

111 sint16 to sint32 [rax] {sint16} 32 


Register Swizzle: S;35 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512i 
_—m512i 


Exceptions 


_mm512_xor_epi32 (_m512i,__m512i); 


_mm512_mask_xor_epi32 (_m512i,_ mmask16,__m512i,__m512i); 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
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Instruction not available in these modes 
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#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 


Reference Number: 327364-001 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VPXORQ - Bitwise XOR Int64 Vectors 
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Opcode Instruction Description 
MVEX.NDS.512.66.0FW1 vpxorq zmm1_ {k1}, zmm2, Perform a bitwise XOR between int64 vector 
EF /r Siga(zmm3/mz) zmm_2 and int64 vector Sig4(zmm3/m;) and 


store the result in zmm1, under write-mask. 


Description 


Performs an element-by-element bitwise XOR between int64 vector zmm2 and the int64 
vector result of the swizzle/broadcast/conversion process on memory or int64 vector 
zmm3. The result is written into int64 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
tmpSrc3[511:0] = SwizzUpConvLoadjg4(zmm3/m;) 

} 


for (n = 0; n < 8; nt++) f{ 
if(ki[n] != 0) { 
i = 64*n 
zmm1[i+63:i] = zmm2[i+63:i] ~ tmpSrc3[it+63:i] 
} 
} 


Flags Affected 


None. 
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Memory Up-conversion: S;¢4 
S25159 || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 
001 broadcast 1 element (x8) [rax] {1to8} 8 
010 broadcast 4 elements (x2) | [rax] {4to8} 32 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 
Register Swizzle: S;e. 

MVEX.EH=0 

S55S1Spo || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512i _mm512_xor_epi64 (_m512i,__m512i); 
_—m512i _mm512_mask_xor_epi64 (_m512i,__mmask8 


| 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 
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#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VRCP23PS - Reciprocal of Float32 Vector 


Opcode Instruction Description 

MVEX.512.66.0F38.W0 CA vrcp23ps zmm1 {k1}, zmm2/m, Compute the approximate reciprocals float32 

/v vector zmm2/m, and store the result in zmm1, 
under write-mask. 


Description 


Computes the element-by-element reciprocal approximation of the float32 vector on 
memory or float32 vector zmm2 with 0.912ULP (relative error). The result is written 
into float32 vector zmm1. 


If any source element is NaN, the quietized NaN source value is returned for that element. 
If any source element is +00, 0.0 is returned for that element. Also, if any source element 
is +0.0, oo is returned for that element. 


Current implementation of this instruction does not support any SwizzUpConv setting 
other than "no broadcast and no conversion"; any other SwizzUpConv setting will result 
in an Invalid Opcode exception. 


recip_1ulp() function follows Table 6.26 when dealing with floating-point special number. 


Input | Result Comment 

NaN _ | input qNaN | raise #I flag if sNaN 
+00 +0 

+0 +00 raise #Z flag 

-0 —oo raise #Z flag 

—oo —0 

2” 2” exact result 


Table 6.26: recip_lulp() special floating-point values behavior 
This instruction is write-masked, so only those elements with the corresponding bit set 


in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


tmpSrc2[511:0] = zmm2/m 

if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 

} 


for (n = 0; n < 16; n++) f{ 
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if Ociln) t= 0) ¢ 
i = 32*n 
zmm1[i+31:i] = recip_1ulp(tmpSrc2[i+31:i]) 
} 
} 


SIMD Floating-Point Exceptions 


Invalid, Zero. 


Denormal Handling 


Treat Input Denormals As Zeros : 
YES 


Flush Tiny Results To Zero : 
YES 


Register Swizzle 


MVEX.EH=0 

S5S1Spo || Function: 4 x 32 bits Usage 
000 no swizzle zmm0 or zmm0 {dcba} 
001 reserved N/A 
010 reserved N/A 
011 reserved N/A 
100 reserved N/A 
101 reserved N/A 
110 reserved N/A 
111 reserved N/A 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 
1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_rcp23_ps (_m512); 
—m512 _mm512_mask_rcp23_ps (_m512,__mmask16,_m512); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 

This instruction does not support any 

SwizzUpConv different from the default value (no broadcast, 
no conversion). If SwizzUpConv function is set to any value 
different than "no action", then an Invalid Opcode fault is 
raised. This includes register swizzles. 
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VRNDFXPNTPD - Round Float64 Vector 


Opcode 


MVEX.512.66.0F3A.W1 52 /r ib 


Instruction 


vrndfxpntpd zmm1 {k1}, Sye4(zmm2/m,), imms 


Description 

Round float64 vector 
Sfea(zmm2/m,) and 
store the result in 
zmm1, using immé8, 
under write-mask. 


Description 


Performs an element-by-element rounding of the result of the swizzle/broadcast/conversion 
from memory or float64 vector zmm2. The rounding result for each element is a float64 
containing an integer or fixed-point value, depending on the value of expadj; the direction 

of rounding depends on the value of RC. The result is written into float64 vector zmm1. 


This instruction doesn't actually convert the result to an int64; the results are float64s, 
just like the input, but are float64s containing the integer or fixed-point values that result 
from the specified rounding and scaling. 


RoundToInt() function follows Table 6.27 when dealing with floating-point special num- 


ber. 


Input | Result 

NaN _ | quietized input NaN 
+00 +00 

+0 +0 

-0 —0 

—oo —oo 


Table 6.27: RoundToInt() special floating-point values behavior 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 


the corresponding bit clear in k1 retain their previous values. 
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Immediate Format 


~ 
na 


Rounding Mode 

rn | Round to Nearest (even) 

rd | Round Down (Round toward Negative Infinity) 
ru | Round Up (Round toward Positive Infinity) 

rz | Round toward Zero 


Rl PR} o|o 
RB] Ol R| ol 


Exponent Adjustment | value Iz Ig Is I 
0 2° (64.0- no exponentadjustment) | 0 0 0 0 
4 2* (60.4) 0 0 O0O 1 
5 2° (59.5) eo 0 £0 
8 28 (56.8) 0 0 1 1 
16 27 (48.16) 0 1 0 O 
24 274 (40.24) 0 1 0 1 
31 9°! (33.31) ie Cees Glee | 
32 2°* (32.32) Oo 1 1 1 
reserved *must UD* 1 x x x 
Operation 


RoundingMode = IMM8[1:0] 
expadj = IMM8[6:4] 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpSrc2[511:0] = zmm2[511:0] 

} else { 
tmpSrc2[511:0] = SwizzUpConvLoad rg (zmm2/m,) 

} 


for (n = 0; n < 8; nt++) f{ 
if(ki[n] != 0) f{ 
i = 64*n 
// float64 operation 
zmm1[i+63:i] = 
RoundToInt (tmpSrc2[i+63:i] * EXPADJ_TABLE[expadj], RoundingMode) / 
EXPADJ_TABLE [expadj] 


SIMD Floating-Point Exceptions 


Invalid, Precision. 
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Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
NO 


Memory Up-conversion: S ¢4 


S2515So || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Register Swizzle: S ¢¢4 


MVEX.EH=0 

S_515p9 || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512d _mm512_roundfxpnt_adjust_pd (_m512d, int, MM_EXP_ADJ_ENUM); 
—m512d _mm512_mask_roundfxpnt_adjust_pd (_.m512d mmask8, _m512d, int , 
_MM_EXP_ADJ_ENUM); 


: 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
#UD 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 


If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VRNDFXPNTPS - Round Float32 


Vector 


Opcode Instruction 
MVEX.512.66.0F3A.W0 52 /rib vrndfxpntps zmm1 {k1}, S32(zmm2/m;),i1mm8 Round float32 vector 


Description 


S'p32(zmm2/m;,) and 
store the result in 
zmm1, using zmmé8, 
under write-mask. 


Description 


Performs an element-by-element rounding of the result of the swizzle/broadcast/conversion 
from memory or float32 vector zmm2. The rounding result for each element is a float32 
containing an integer or fixed-point value, depending on the value of expadj; the direction 

of rounding depends on the value of RC. The result is written into float32 vector zmm1. 


This instruction doesn't actually convert the result to an int32; the results are float32s, 
just like the input, but are float32s containing the integer or fixed-point values that result 
from the specified rounding and scaling. 


RoundToInt() function follows Table 6.28 when dealing with floating-point special num- 


ber. 


This instruction treats input denormals as zeros according to the DAZ control bit, but does 


not flush tiny results to zero. 


Input | Result 

NaN _ | quietized input NaN 
+00 +00 

+0 +0 

-0 —0 

—oo —oo 


Table 6.28: RoundToInt() special floating-point values behavior 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 


the corresponding bit clear in k1 retain their previous values. 


Immediate Format 


Rounding Mode I, Ip 
rn | Round to Nearest (even) 0 O 
rd | Round Down (Round toward Negative Infinity) | 0 1 
ru | Round Up (Round toward Positive Infinity) 1 O 
rz | Round toward Zero 1 1 
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Exponent Adjustment | value Iz Ig Is I 
0 2° (32.0- no exponent adjustment) | 0 0 0 0 
4 27 (28.4) 0 0 0 1 
5 9° (27.5) 0 0 1 =O 
8 25 (24.8) 0 0 1 4 
16 27 (16.16) oO £' 2) oO 
24 274 (8.24) 0 1 0 1 
31 or 131) 0 1 1 =O 
32 9° (0.32) a a res | 
reserved *must UD* 1 x x x 
Operation 


RoundingMode = IMM8[1:0] 
expadj = IMM8([6:4] 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
tmpSrc2[511:0] = zmm2[511:0] 

} else { 
tmpSrc2[511:0] = SwizzUpConvLoad p32 (zmm2/m,) 

} 


for (n = 0; n < 16; n++) f{ 
if(ki[n] != 0) f{ 
i = 32*n 
// f£loat32 operation 
zmm1[it+31:i] = 
RoundToInt (tmpSrc2[i+31:i] * EXPADJ_TABLE[expadj], RoundingMode) / 
EXPADJ_TABLE [expadj] 


SIMD Floating-Point Exceptions 


Invalid, Precision. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
NO 
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Memory Up-conversion: S;35 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 

001 broadcast 1 element (x16) | [rax] {1to16} 4 

010 broadcast 4 elements (x4) | [rax] {4to16} 16 

011 float16 to float32 [rax] {float16} 32 

100 uint8 to float32 [rax] {uint8} 16 

110 uint16 to float32 [rax] {uint16} 32 

111 sint16 to float32 [rax] {sint16} 32 


Register Swizzle: S35 


MVEX.EH=0 
S55S1Spo || Function: 4 x 32 bits Usage 
000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 
525159 || Rounding Mode Override Usage 
1xx SAE (Supress-All-Exceptions) , {sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512 
_—m512 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 
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Instruction not available in these modes 


_mmask16, 


_mm512_roundfxpnt_adjust_ps (_m512, int, MM_EXP_ADJ_ENUM); 
_mm512_mask_roundfxpnt_adjust_ps (_m512, 
_MM_EXP_ADJ_ENUM); 


_m512, 


int 
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64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
#UD 
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If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 


If processor model does not implement the specific instruction. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VRSQRT23PS - Vector Reciprocal Square Root of Float32 Vector 


588 


Opcode Instruction Description 


MVEX.512.66.0F38.W0 CB vrsqrt23ps zmm1 {k1},zmm2/m,; Reciprocal square _ root 


/v 


float32 


vector 


zmm2/m, and store the result in zmm1, 


under write-mask. 


Description 


Computes the element-by-element reciprocal square root of the float32 vector on memory 
or float32 vector zmm2 with a precision of 0.775ULP (relative error). The result is written 
into float32 vector zmm1. 


If any source element is NaN, the quietized NaN source value is returned for that element. 
Negative source numbers, as well as —oo, return the canonical NaN and set the Invalid 
Flag (#I). 


Current implementation of this instruction does not support any SwizzUpConv setting 
other than "no broadcast and no conversion"; any other SwizzUpConv setting will result 
in an Invalid Opcode exception. 


rsqrt_lulp() function follows Table 6.29 when dealing with floating-point special number. 


For an input value of +/ — 0 the instruction returns —oo and sets the Divide-By-Zero flag 
(#Z). Negative numbers should return NaN and set the Invalid flag (#1). Note however that 
this instruction treats input denormals as zeros of the same sign, so for denormal negative 
inputs it returns —oo and sets the Divide-By-Zero status flag. 


Input | Result Comments 

NaN _ | input qNaN | Raise #I flag if sNaN 
+00 +0 

+0 +00 Raise #Z flag 

—0 —oo Raise #Z flag 

<0 NaN Raise #I flag 

—oo NaN Raise #I flag 

a a exact result 


Table 6.29: rsqrt_1ulp() special floating-point values behavior 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 
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Operation 


tmpSrc2[511:0] = zmm2/m: 


if(source is a register operand and MVEX.EH bit is 1) { 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
} 
for (n = 0; n < 16; n++) f{ 
if (kifm] != 0) f 
i = 32*n 
zmm1[i+31:i] = rsqrt_1ulp(tmpSrc2[i+31:i]) 


} 
z 


SIMD Floating-Point Exceptions 


Invalid, Zero. 


Denormal Handling 


Treat Input Denormals As Zeros : 
YES 


Flush Tiny Results To Zero : 
YES 


Register Swizzle 


MVEX.EH=0 
S5S1Spo || Function: 4 x 32 bits Usage 
000 no swizzle zmm0 or zmm0 {dcba} 
001 reserved N/A 
010 reserved N/A 
011 reserved N/A 
100 reserved N/A 
101 reserved N/A 
110 reserved N/A 
111 reserved N/A 
MVEX.EH=1 
S$25Sq || Rounding Mode Override Usage 
1xx SAE (Supress-All-Exceptions) , {sae} 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512 _ICL_INTRINCC_mm512_rsqrt23_ps (_m512); 
_—m512 _ICL_INTRINCC_mm512_mask_rsqrt23_ps (_m512,_mmask16,__m512); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 

This instruction does not support any 

SwizzUpConv different from the default value (no broadcast, 
no conversion). If SwizzUpConv function is set to any value 
different than "no action", then an Invalid Opcode fault is 
raised. This includes register swizzles. 
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VSCALEPS - Scale Float32 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.W0O vscaleps zmm1 {k1}, zmm2, Multiply float32 vector zmm2 by 2 raised to the 

84 /r Sizo(zmm3/mz) int32 vector S;32(zmm3/m;) and store the re- 
sult in zmm1, under write-mask. 


Description 


Performs an element-by-element scale of float32 vector zmm2 by multiplying it by 2°*?, 
where exp is the vector int32 result of the swizzle/broadcast/conversion process on 
memory or vector int32 zmm3. The result is written into vector float32 zmm1. 


This instruction is needed for scaling u and v coordinates according to the mipmap size, 
which is 2"P™4p_!evel, and for the evaluation of Exp2. 


Cases where the exponent would go out of range are handled as if multiplication (via 
vmulps) of zmm2 by 27””"? had been performed. 


If the result cannot be represented with a float32, then the properly signed oo (for positive 
scaling operand) or 0 (for negative scaling operand) will be returned. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 

} else { 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoadI (zmm3/m) 
} 


for (n = 0; n < 16; n++) f{ 
if (kilm] != 0) f 
i = 32*n 
exp[31:0] = tmpSrc3[i+31:i] 
// signed int scale operation. float32 multiplication 
zmmi[i+31:i] = zmm2[it31:i] * 2°7?/510] 
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SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 


Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S;35 


$2515 


Function: 


Usage 


disp8*N 


000 
001 
010 
011 
100 
101 
110 
111 


no conversion 

broadcast 1 element (x16) 
broadcast 4 elements (x4) 
reserved 

uint8 to uint32 

sint8 to sint32 

uint16 to uint32 

sint16 to sint32 


[rax] {16to16} or [rax] 
[rax] {1to16} 

[rax] {4to16} 

N/A 

[rax] {uint8} 

[rax] {sint8} 

[rax] {uint16} 

[rax] {sint16} 


64 
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Register Swizzle: S;3. 


MVEX.EH=0 

S2S1So || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

52515 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 


Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_scale_ps (_m512,__m512i); 
—m512 _mm512_mask_scale_ps (_m512,_mmask16,_m512,__m512i); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 


in a non-canonical form. 
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#GP(0) If the memory address is in a non-canonical form. 
If a memory operand linear address is not aligned 
to the data size granularity dictated by SwizzUpConv 


mode. 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 


594 Reference Number: 327364-001 


= 
=r 
( 


CHAPTER 6. INSTRUCTION DESCRIPTIONS 


VSCATTERDPD - Scatter Float64 Vector With Signed Dword Indices 


Opcode Instruction Description 
MVEX.512.66.0F38.W1 A2_ vscatterdpd MUy {k1}, Scatter float64 vector Dyg4(zmm1) to vector 
/r /vsib D yea(zmm1) memory locations mv, using doubleword in- 


dices and k1 as completion mask. 


Description 


Down-converts and stores all 8 elements in float64 vector zmm1 to the memory locations 
pointed by base address BAS E_ADDR and doubleword index vector VIN DEX, with 
scale SCALE. 


Note the special mask behavior as only a subset of the active elements of write mask k1 
are actually operated on (as denoted by function SELECT_SUBSET). There are only 
two guarantees about the function: (a) the destination mask is a subset of the source mask 
(identity is included), and (b) on a given invocation of the instruction, at least one element 
(the least significant enabled mask bit) will be selected from the source mask. 


Programmers should always enforce the execution of a gather/scatter instruction to be 
re-executed (via a loop) until the full completion of the sequence (i.e. all elements of the 
gather/scatter sequence have been loaded/stored and hence, the write-mask bits all are 
zero). 


Writes to overlapping destination memory locations are guaranteed to be ordered with 
respect to each other (from LSB to MSB of the source registers). Only writes to overlapping 
vector indices are guaranteed to be ordered with respect to each other (from LSB to MSB 
of the source registers). Writes that are not overlapped may happen in any order. Memory 
ordering with other instructions follows the Intel-64 memory ordering model. Note that 
this does not account for non-overlapping indices that map into the same physical address 
locations. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element after down-conversion. 


Note also the special mask behavior as the corresponding bits in write mask k1 are reset 
with each destination element being updated according to the subset of write mask k1. 
This is useful to allow conditional re-trigger of the instruction until all the elements from 
a given write mask have been successfully stored. 


Operation 


// instruction works over a subset of the write mask 
ktemp = SELECT_SUBSET(k1) 


// Use muy, as vector memory operand (VSIB) 
for (n = 0; n < 8; nt++) f{ 


Reference Number: 327364-001 


595 


> 
D 


CHAPTER 6. INSTRUCTION DESCRIPTIONS 


if (ktemp[n] != 0) { 
i = 64*n 
j = 32+*n 
// mvu,[n] = BASE_ADDR + SignExtend(VINDEX[j+31:j] * SCALE) 
pointer [63:0] = mv; [n] 
tmp = DownConvStore r¢g4(zmmi[i+63:i], SSS[2:0]) 
if (DownConvStoreSizeOf fea (SSS[2:0]) == 8) f 
MemStore(pointer) = tmp[63:0] 
} 
ki[n] = 0 
} 
} 
ki[15:8] = 0 


SIMD Floating-Point Exceptions 


None. 


Memory Down-conversion: D ¢4 


S2515S9 || Function: Usage disp8*N 
000 no conversion zmm1 8 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_i32loextscatter_pd (void*, _m512i, _m512d, 
_MM_DOWNCONV_PD_ENUM, int, int); 

void _mm512_mask_i32loextscatter_.pd (void*, _mmask8, _m512i, _m512d, 
_MM_DOWNCONV_PD_ENUM, int, int); 

void _mm512_i32loscatter_pd (void*, m512i,__m512d, int); 

void _mm512_mask_i32loscatter_pd (void*,__mmask8,__m512i,__m512d, int); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form, and corresponding write-mask bit is not zero. 
#GP(0) If a memory address is in a non-canonical form, 


and corresponding write-mask bit is not zero. 
If a memory operand linear address is not aligned 
to element-wise data granularity dictated by the DownConv 
mode, and corresponding write-mask bit is not zero. 
#PF(fault-code) If a memory operand linear address produces a page fault 
and corresponding write-mask bit is not zero. 
#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If using a 16 bit effective address. 
If ModRM.rm is different than 100b. 
If no write mask is provided or selected write-mask is k0. 
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Opcode Instruction Description 
MVEX.512.66.0F38.W0 A2_ vscatterdps Muy {k1}, Scatter float32 vector Dy32(zmm1) to vector 
/r /vsib D y32(zmm1) memory locations mv; using doubleword in- 


dices and k1 as completion mask. 


Description 


Down-converts and stores all 16 elements in float32 vector zmm1 to the memory loca- 
tions pointed by base address BAS E_ADDR and doubleword index vector VINDEX, 
with scale SCALE. 


Note the special mask behavior as only a subset of the active elements of write mask k1 
are actually operated on (as denoted by function SELECT_SUBSET). There are only 
two guarantees about the function: (a) the destination mask is a subset of the source mask 
(identity is included), and (b) on a given invocation of the instruction, at least one element 
(the least significant enabled mask bit) will be selected from the source mask. 


Programmers should always enforce the execution of a gather/scatter instruction to be 
re-executed (via a loop) until the full completion of the sequence (i.e. all elements of the 
gather/scatter sequence have been loaded/stored and hence, the write-mask bits all are 
zero). 


Writes to overlapping destination memory locations are guaranteed to be ordered with 
respect to each other (from LSB to MSB of the source registers). Only writes to overlapping 
vector indices are guaranteed to be ordered with respect to each other (from LSB to MSB 
of the source registers). Writes that are not overlapped may happen in any order. Memory 
ordering with other instructions follows the Intel-64 memory ordering model. Note that 
this does not account for non-overlapping indices that map into the same physical address 
locations. 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element after down-conversion. 


Note also the special mask behavior as the corresponding bits in write mask k1 are reset 
with each destination element being updated according to the subset of write mask k1. 
This is useful to allow conditional re-trigger of the instruction until all the elements from 
a given write mask have been successfully stored. 


Operation 


// instruction works over a subset of the write mask 
ktemp = SELECT_SUBSET(k1) 


// Use muy, as vector memory operand (VSIB) 
for (n = 0; n < 16; n++) { 
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if (ktemp[n] 
i = 32*n 


'= 0) { 


// mv,{n] = BASE_ADDR + SignExtend(VINDEX[i+31:i] * SCALE) 


pointer[63:0] = mv;[n] 


tmp = DownConvStore 32(zmm1[i+31:i], SSS[2:0]) 


if (DownConvStoreSizeOf f32(SSS[2:0]) == 4) f 
MemStore(pointer) = tmp[31:0] 
} else if (DownConvStoreSizeOf r32(SSS[2:0]) == 2) { 
MemStore(pointer) = tmp[15:0] 
} else if (DownConvStoreSizeDf f32(SSS[2:0]) == 1) { 
MemStore(pointer) = tmp[7:0] 
} 
ki[n] = 0 
} 
} 
SIMD Floating-Point Exceptions 
Overflow, Underflow, Invalid, Precision, Denormal. 
Memory Down-conversion: D 32 
S25159 || Function: Usage disp8*N 
000 no conversion zmm1 4 
001 reserved N/A N/A 
010 reserved N/A N/A 
011 float32 to float16 zmm1 {float16} 2 
100 float32 to uint8 zmm1 {uint8} 1 
101 float32 to sint8 zmm1 {sint8} 1 
110 float32 to uint16 zmm1 {uint16} 2 
111 float32 to sint16 zmm1 {sint16} 2 
Intel’ C/C++ Compiler Intrinsic Equivalent 
void _mm512_i32extscatter_ps (void*, _m512i, _m512, 
_MM_DOWNCONV_PS_ENUM, int, int); 
void _mm512_mask_i32extscatter_s (void*, _mmask16, _m512i, _m512, 
_MM_DOWNCONV_PS_ENUM, int, int); 
void _mm512_i32scatter_ps (void*, m512i,__m512, int); 
void _mm512_mask_i32scatter_ps (void*,__mmask16,_m512i,_m512, int); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form, and corresponding write-mask bit is not zero. 
#GP(0) If a memory address is in a non-canonical form, 


and corresponding write-mask bit is not zero. 
If a memory operand linear address is not aligned 
to element-wise data granularity dictated by the DownConv 
mode, and corresponding write-mask bit is not zero. 
#PF(fault-code) If a memory operand linear address produces a page fault 
and corresponding write-mask bit is not zero. 
#NM If CRO.TS[bit 3]=1. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If using a 16 bit effective address. 
If ModRM.rm is different than 100b. 
If no write mask is provided or selected write-mask is k0. 
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VSCATTERPFODPS - Scatter Prefetch Float32 Vector With Signed Dword 
Indices Into L1 


Opcode Instruction Description 
MVEX.512.66.0F38.W0 C6 vscatterpf0dps Ur32(mv;) {k1} Scatter Prefetch float32 vector U32(mv,), us- 
/5 /vsib ing doubleword indices with TO hint, under 
write-mask. 
Description 


Prefetches into the L1 level of cache the memory locations pointed by base address 
BASE_ADDR and doubleword index vector VINDEX, with scale SCALE, with re- 
quest for ownership (exclusive). Up-conversion operand specifies the granularity used 
by compilers to better encode the instruction if a displacement, using disp8*N feature, is 
provided when specifying the address. If any memory access causes any type of mem- 
ory exception, the memory access will be considered as completed (destination mask up- 
dated) and the exception ignored. Up-conversion parameter is optional, and it is used to 
correctly encode disp8*N. 


Note the special mask behavior as only a subset of the active elements of write mask k1 
are actually operated on (as denoted by function SELECT_SUBSET). There are only 
two guarantees about the function: (a) the destination mask is a subset of the source mask 
(identity is included), and (b) on a given invocation of the instruction, at least one element 
(the least significant enabled mask bit) will be selected from the source mask. 


Programmers should always enforce the execution of a gather/scatter instruction to be 
re-executed (via a loop) until the full completion of the sequence (i.e. all elements of the 
prefetch sequence have been prefetched and hence, the write-mask bits all are zero). 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element after up-conversion. 


Note also the special mask behavior as the corresponding bits in write mask k1 are reset 
with each destination element being updated according to the subset of write mask k1. 
This is useful to allow conditional re-trigger of the instruction until all the elements from 
a given write mask have been successfully stored. 


Note that both gather and scatter prefetches set the access bit (A) in the related TLB page 
entry. Scatter prefetches (which prefetch data with RFO) do not set the dirty bit (D). 


Operation 


// instruction works over a subset of the write mask 
ktemp = SELECT_SUBSET(k1) 


exclusive = 1 
evicthintpre = MVEX.EH 
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// Use muy, as vector memory operand (VSIB) 
for (n = 0; n < 16; n++) f{ 
if (ktemp[n] != 0) { 
i = 32*n 
// mu;[n] = BASE_ADDR + SignExtend(VINDEX[i+31:i] * SCALE) 
pointer [63:0] = mv; [n] 
FetchLicacheLine(pointer, exclusive, evicthintpre) 
kif{n] = 0 


SIMD Floating-Point Exceptions 


None. 


Memory Up-conversion: U3. 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 float16 to float32 [rax] {float16} 2 

100 uint8 to float32 [rax] {uint8} 1 

101 sint8 to float32 [rax] {sint8} 1 

110 uint16 to float32 [rax] {uint16} 2 

111 sint16 to float32 [rax] {sint16} 2 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_prefetch_i32extscatter_ps (void*, _m512i, _MM_UPCONV_PS_ENUM, 
int, int); 

void _mm512_mask_prefetch_i32extscatter_ps(void*, __mmask16, _m512i, 
_MM_UPCONV_PS_ENUM, int, int); 

void _mm512_prefetch_i32scatter_ps(void*, _m512i, int, int); 

void _mm512_mask_prefetch_i32scatter_ps(void*, mmask16, _m512i, int, int); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 

If using a 16 bit effective address. 

If ModRM.rm is different than 100b. 

If no write mask is provided or selected write-mask is k0. 
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VSCATTERPFOHINTDPD - Scatter Prefetch Float64 Vector Hint With Signed 
Dword Indices 


Opcode Instruction Description 
MVEX.512.66.0F38.W1 C6 vscatterpfOhintdpd Uyea(mu;) Scatter Prefetch float64 vector Usg4(mv;), us- 
/4 /vsib {k1} ing doubleword indices with TO hint, under 
write-mask. 
Description 


The instruction specifies a set of 8 float64 memory locations pointed by base address 
BASE_ADDR and doubleword index vector VN DEX with scale SCALE as a perfor- 
mance hint that a real scatter instruction with the same set of sources will be invoked. A 
programmer may execute this instruction before a real scatter instruction to improve its 
performance. 


This instruction is a hint and may be speculative, and may be dropped or specify invalid 
addresses without causing problems or memory related faults. This instructions does not 
modify any kind of architectural state (including the write-mask). 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Operation 


// Use mu, as vector memory operand (VSIB) 
for (n = 0; n < 8; nt++) { 
if (kifm] != 0) ¢ 
i = 64*n 
j = 324n 
// mvu,[n] = BASE_ADDR + SignExtend(VINDEX[j+31:j] * SCALE) 
pointer [63:0] = mv; [n] 
HintPointer (pointer) 


SIMD Floating-Point Exceptions 


None. 
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Memory Up-conversion: U y¢4 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] 8 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Intel’ C/C++ Compiler Intrinsic Equivalent 


None 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 


#NM 
#UD 
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Instruction not available in these modes 


If CRO.TS[bit 3]=1. 

If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 

If using a 16 bit effective address. 

If ModRM.rm is different than 100b. 

If no write mask is provided or selected write-mask is k0. 
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VSCATTERPFOHINTDPS - Scatter Prefetch Float32 Vector Hint With Signed 
Dword Indices 
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Opcode Instruction Description 
MVEX.512.66.0F38.W0 C6 vscatterpfOhintdps Urz32(mv,) Scatter Prefetch float32 vector Us32(mz;), us- 
/4 /vsib {k1} ing doubleword indices with TO hint, under 
write-mask. 
Description 


The instruction specifies a set of 16 float32 memory locations pointed by base address 
BASE_ADDR and doubleword index vector VN DEX with scale SCALE as a perfor- 
mance hint that a real scatter instruction with the same set of sources will be invoked. A 
programmer may execute this instruction before a real scatter instruction to improve its 
performance. 


This instruction is a hint and may be speculative, and may be dropped or specify invalid 
addresses without causing problems or memory related faults. This instructions does not 
modify any kind of architectural state (including the write-mask). 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element before up-conversion. 


Operation 


// Use mu, as vector memory operand (VSIB) 
for (n = 0; n < 16; n++) f{ 
if (kiln] != 0) f 
i = 32*n 
// mu,[n] = BASE_ADDR + SignExtend(VINDEX[i+31:i] * SCALE) 
pointer [63:0] = mv; [n] 
HintPointer (pointer) 
} 
} 


SIMD Floating-Point Exceptions 


None. 
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Memory Up-conversion: U;3. 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 float16 to float32 [rax] {float16} 2 

100 uint8 to float32 [rax] {uint8} 1 

101 sint8 to float32 [rax] {sint8} 1 

110 uint16 to float32 [rax] {uint16} 2 

111 sint16 to float32 [rax] {sint16} 2 


Intel’ C/C++ Compiler Intrinsic Equivalent 


None 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 


#NM 
#UD 
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If CRO.TS[bit 3]=1. 


If processor model does not implement the specific instruction. 
If preceded by any REX, FO, F2, F3, or 66 prefixes. 

If using a 16 bit effective address. 

If ModRM.rm is different than 100b. 
If no write mask is provided or selected write-mask is k0. 
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Opcode Instruction Description 
MVEX.512.66.0F38.W0 C6 vscatterpfidps Ur32(mv;) {k1} Scatter Prefetch float32 vector U32(mv;), us- 
/6 /vsib ing doubleword indices with T1 hint, under 
write-mask. 
Description 


Prefetches into the L2 level of cache the memory locations pointed by base address 
BASE_ADDR and doubleword index vector VI[NDEX, with scale SCALE, with re- 
quest for ownership (exclusive). Down-conversion operand specifies the granularity used 
by compilers to better encode the instruction if a displacement, using disp8*N feature, is 
provided when specifying the address. If any memory access causes any type of mem- 
ory exception, the memory access will be considered as completed (destination mask up- 
dated) and the exception ignored. Down-conversion parameter is optional, and it is used 
to correctly encode disp8*N. 


Note the special mask behavior as only a subset of the active elements of write mask k1 
are actually operated on (as denoted by function SELECT_SUBSET). There are only 
two guarantees about the function: (a) the destination mask is a subset of the source mask 
(identity is included), and (b) on a given invocation of the instruction, at least one element 
(the least significant enabled mask bit) will be selected from the source mask. 


Programmers should always enforce the execution of a gather/scatter instruction to be 
re-executed (via a loop) until the full completion of the sequence (i.e. all elements of the 
prefetch sequence have been prefetched and hence, the write-mask bits all are zero). 


This instruction has special disp8*N and alignment rules. N is considered to be the size 
of a single vector element after down-conversion. 


Note also the special mask behavior as the corresponding bits in write mask k1 are reset 
with each destination element being updated according to the subset of write mask k1. 
This is useful to allow conditional re-trigger of the instruction until all the elements from 
a given write mask have been successfully stored. 


Note that both gather and scatter prefetches set the access bit (A) in the related TLB page 
entry. Scatter prefetches (which prefetch data with RFO) do not set the dirty bit (D). 


Operation 


// instruction works over a subset of the write mask 
ktemp = SELECT_SUBSET(k1) 


exclusive = 1 
evicthintpre = MVEX.EH 
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// Use muy, as vector memory operand (VSIB) 
for (n = 0; n < 16; n++) f{ 
if (ktemp[n] != 0) { 
i = 32*n 
// mu;,[n] = BASE_ADDR + SignExtend(VINDEX[i+31:i] * SCALE) 
pointer [63:0] = mv; [n] 
FetchL2cacheLine(pointer, exclusive, evicthintpre) 
kif] = 0 


SIMD Floating-Point Exceptions 


None. 


Memory Down-conversion: D 32 


S25159 || Function: Usage disp8*N 
000 no conversion zmm1 4 

001 reserved N/A N/A 
010 reserved N/A N/A 
011 float32 to float16 zmm1 {float16} 2 

100 float32 to uint8 zmm1 {uint8} 1 

101 float32 to sint8 zmm1 {sint8} 1 

110 float32 to uint16 zmm1 {uint16} 2 

111 float32 to sint16 zmm1 {sint16} 2 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm512_prefetch_i32extscatter_ps (void*, _m512i, _MM_UPCONV_PS_ENUM, 
int, int); 

void _mm512_mask_prefetch_i32extscatter_ps(void*, __mmask16, _m512i, 
_MM_UPCONV_PS_ENUM, int, int); 

void _mm512_prefetch_i32scatter_ps(void*, _m512i, int, int); 

void _mm512_mask_prefetch_i32scatter_ps(void*, mmask16, _m512i, int, int); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
64 bit Mode 
#NM If CRO.TS[bit 3]=1. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 

If using a 16 bit effective address. 

If ModRM.rm is different than 100b. 

If no write mask is provided or selected write-mask is k0. 
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VSUBPD - Subtract Float64 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0FW1 vsubpd zmmi1_ {kl}, zmm2, Subtract float64 vector Syg4(zmm3/m,) from 

5C /r Sea(zmm3/m+) float64 vector zmm2 and store the result in 
zmm1, under write-mask. 


Description 


Performs an element-by-element subtraction from float64 vector zmm2 of the float64 
vector result of the swizzle/broadcast/conversion process on memory or float64 vector 
zmm3. The result is written into float64 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad fe4 (zmm3/m,) 


} 


for (n = 0; n < 8; nt++) f{ 
if(kifm] != 0) f 
i = 64*n 
// float64 operation 
zmm1[i+63:i] = zmm2[i+63:i] - tmpSrc3[it+63:i] 
} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 
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Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S 64 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Register Swizzle: S ¢¢4 


MVEX.EH=0 

S25S1Spo || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512d _mm512_sub_pd (_m512d,_m512d); 
—m512d _mm512_mask_sub_pd (_m512d,_mmask8,_m512d,_m512d); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VSUBPS - Subtract Float32 Vectors 


Opcode Instruction Description 
MVEX.NDS.512.0FW0O5C/r vsubps zmm1_ {k1}, zmm2, Subtract float32 vector S32(zmm3/m;) from 
S'p32(zmm3/mz) float32 vector zmm2 and store the result in 
zmm1, under write-mask. 


Description 


Performs an element-by-element subtraction from float32 vector zmm2 of the float32 
vector result of the swizzle/broadcast/conversion process on memory or float32 vector 
zmm3. The result is written into float32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad p32 (zmm3/m) 


} 


for (n = 0; n < 16; n++) f{ 
if(kifm] != 0) f 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = zmm2[i+31:i] - tmpSrc3[it+31:i] 
} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 
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Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 
001 broadcast 1 element (x16) | [rax] {1to16} 4 
010 broadcast 4 elements (x4) | [rax] {4to16} 16 
011 float16 to float32 [rax] {float16} 32 
100 uint8 to float32 [rax] {uint8} 16 
110 uint16 to float32 [rax] {uint16} 32 
111 sint16 to float32 [rax] {sint16} 32 
Register Swizzle: S 3. 

MVEX.EH=0 

S251Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 
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> 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512 _mm512_sub_ps (_m512,_m512); 
—m512 _mm512_mask_sub_ps (_m512,_mmask16,__m512,__m512); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VSUBRPD - Reverse Subtract Float64 Vectors 


Opcode Instruction Description 

MVEX.NDS.512.66.0F38.W1 vsubrpd zmm1 {k1}, zmm2, Subtract float64 vector zmm2 from float64 vec- 

6D /r Sea(zmm3/mz) tor Sg4(zmm3/m;) and store the result in 
zmm1, under write-mask. 


Description 


Performs an element-by-element subtraction of float64 vector zmm2 from the float64 
vector result of the swizzle/broadcast/conversion process on memory or float64 vector 
zmm3. The result is written into float64 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 
the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 
if (SSS[2]==1) Supress_Exception_Flags() // SAE 
// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 
RoundingMode = SSS[1:0] 
tmpSrc3[511:0] = zmm3[511:0] 
} else f{ 
RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad fe4 (zmm3/m,) 


} 


for (n = 0; n < 8; nt++) f{ 
if(kifm] != 0) f 
i = 64*n 
// float64 operation 
zmm1[i+63:i] = -zmm2[i+63:i] + tmpSrc3[i+63:i] 
} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 
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Denormal Handling 


Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S 64 


S2515o || Function: Usage disp8*N 
000 no conversion [rax] {8to8} or [rax] 64 

001 broadcast 1 element (x8) [rax] {1to8} 8 

010 broadcast 4 elements (x2) | [rax] {4to8} 32 

011 reserved N/A N/A 
100 reserved N/A N/A 
101 reserved N/A N/A 
110 reserved N/A N/A 
111 reserved N/A N/A 


Register Swizzle: S ¢¢4 


MVEX.EH=0 

S25S1Spo || Function: 4 x 64 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 
010 swap with two-away zmm0 {badc} 
011 cross-product swizzle zmm0 {dacb} 
100 broadcast a element zmm0 {aaaa} 
101 broadcast b element zmm0 {bbbb} 
110 broadcast c element zmm0 {cccc} 
111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


_—m512d _mm512_subr_pd (_m512d,_m512d); 


—m512d _mm512_mask_subr_pd (_m512d,_mmask8,_m512d,_m512d); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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VSUBRPS - Reverse Subtract Float32 Vectors 


Opcode Instruction Description 
MVEX.NDS.512.66.0F38.WO vsubrps zmm1 {ki}, zmm2, Subtract float32 vector zmm2 from float32 vec- 
6D /r S'p32(zmm3/mz) tor S'32(zmm3/m;) and store the result in 
zmm1, under write-mask. 
Description 


Performs an element-by-element subtraction of float32 vector zmm2 from the float32 
vector result of the swizzle/broadcast/conversion process on memory or float32 vector 


zmm3. The result is written into float32 vector zmm1. 


This instruction is write-masked, so only those elements with the corresponding bit set 
in vector mask register k1 are computed and stored into zmm1. Elements in zmm1 with 


the corresponding bit clear in k1 retain their previous values. 


Operation 


if(source is a register operand and MVEX.EH bit is 1) f{ 


if (SSS[2]==1) Supress_Exception_Flags() // SAE 


// SSS are bits 6-4 from the MVEX prefix encoding. For more details, see Table2.14 


RoundingMode = SSS[1:0] 

tmpSrc3[511:0] = zmm3[511:0] 
} else { 

RoundingMode 


= MXCSR.RC 
tmpSrc3[511:0] = 


SwizzUpConvLoad p32 (zmm3/m) 


} 


for (n = 0; n < 16; n++) f{ 
if(kifm] != 0) f 
i = 32*n 
// float32 operation 
zmm1[i+31:i] = -zmm2([i+31:i] + tmpSrc3[i+31:i] 
} 
} 


SIMD Floating-Point Exceptions 


Overflow, Underflow, Invalid, Precision, Denormal. 
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Denormal Handling 
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Treat Input Denormals As Zeros : 
(MXCSR.DAZ)? YES : NO 


Flush Tiny Results To Zero : 
(MXCSR.FZ)? YES : NO 


Memory Up-conversion: S;35 


S25159 || Function: Usage disp8*N 
000 no conversion [rax] {16to16} or [rax] 64 
001 broadcast 1 element (x16) | [rax] {1to16} 4 
010 broadcast 4 elements (x4) | [rax] {4to16} 16 
011 float16 to float32 [rax] {float16} 32 
100 uint8 to float32 [rax] {uint8} 16 
110 uint16 to float32 [rax] {uint16} 32 
111 sint16 to float32 [rax] {sint16} 32 
Register Swizzle: S 3. 

MVEX.EH=0 

S251Spo || Function: 4 x 32 bits Usage 

000 no swizzle zmm0 or zmm0 {dcba} 
001 swap (inner) pairs zmm0 {cdab} 

010 swap with two-away zmm0 {badc} 

011 cross-product swizzle zmm0 {dacb} 

100 broadcast a element zmm0 {aaaa} 

101 broadcast b element zmm0 {bbbb} 

110 broadcast c element zmm0 {cccc} 

111 broadcast d element zmm0 {dddd} 
MVEX.EH=1 

525159 || Rounding Mode Override Usage 

000 Round To Nearest (even) , {rn} 

001 Round Down (-INF) , {rd} 

010 Round Up (+INF) , {ru} 

011 Round Toward Zero , {rz} 

100 Round To Nearest (even) with SAE , {rn-sae} 

101 Round Down (-INF) with SAE , {rd-sae} 

110 Round Up (+INF) with SAE , {ru-sae} 

111 Round Toward Zero with SAE , {rz-sae} 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


—m512 _mm512_subr_ps (_m512,_m512); 
—m512 _mm512_mask_subr_ps (_m512,__mmask16,_m512,__m512); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD 


Instruction not available in these modes 


Protected and Compatibility Mode 


#UD 


64 bit Mode 
#SS(0) 


#GP(0) 


#PF(fault-code) 
#NM 
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Instruction not available in these modes 


If a memory address referencing the SS segment is 
in a non-canonical form. 

If the memory address is in a non-canonical form. 

If a memory operand linear address is not aligned 

to the data size granularity dictated by SwizzUpConv 
mode. 

For a page fault. 

If CRO.TS[bit 3]=1. 

If preceded by any REX, FO, F2, F3, or 66 prefixes. 
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Appendix A 


Scalar Instruction Descriptions 


In this Chapter all the special scalar instructions introduced with the rbni are described. 
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CLEVICTO - Evict L1 line 


Opcode Instruction Description 
VEX.128.F2.0F AE /7 clevictO m8 = Evict memory line from L1 in m8 using TO hint. 
MVEX.512.F2.0F AE /7 clevictO0m8 Evict memory line from L1 in m8 using TO hint. 


Description 


Invalidates from the first-level cache the cache line containing the specified linear address 
(updating accordingly the cache hierarchy if the line is dirty). Note that, unlike CLFLUSH, 
the invalidation is not broadcasted throughout the cache coherence domain. 


The MVEX form of this instruction uses disp8*64 addressing. Displacements that would 
normally be 8 bits according to the ModR/M byte are still 8 bits but scaled by 64 so that 
they have cache-line granularity. VEX forms of this instruction uses regular disp8 address- 
ing. 


This instruction is a hint intended for performance and may be speculative, thus may be 
dropped or specify invalid addresses without causing problems. The instruction does not 
produce any type of memory-related fault. 


Operation 


FlushLiCacheLine(linear_address) 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm_clevict (const void*, int); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If operand is not amemory location. 
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CLEVICT1 - Evict L2 line 


Opcode Instruction Description 
VEX.128.F3.0F AE /7 clevictl m8 —_Evict memory line from L2 in m8 using T1 hint. 
MVEX.512.F3.0F AE /7 clevictlm8 Evict memory line from L2 in m8 using T1 hint. 


Description 


Invalidates from the second-level cache the cache line containing the specified linear ad- 
dress (updating accordingly the cache hierarchy if the line is dirty). Note that, unlike 
CLFLUSH, the invalidation is not broadcasted throughout the cache coherence domain. 


The MVEX form of this instruction uses disp8*64 addressing. Displacements that would 
normally be 8 bits according to the ModR/M byte are still 8 bits but scaled by 64 so that 
they have cache-line granularity. VEX forms of this instruction uses regular disp8 address- 


ing. 


This instruction is a hint intended for performance and may be speculative, thus may be 
dropped or specify invalid addresses without causing problems. The instruction does not 
produce any type of memory-related fault. 


Operation 


FlushL2CacheLine(linear_address) 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm_clevict (const void*, int); 
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Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If operand is not amemory location. 
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DELAY - Stall Thread 


Opcode Instruction Description 
VEX.128.F3.0R WO AE /6 = delay r32 Stall Thread using r32. 
VEX.128.F3.0FW1 AE /6_ delay r64 Stall Thread using r64. 


Description 


Hints that the processor should not fetch/issue instructions for the current thread for the 
specified number of clock cycles in register source. The maximum number of clock cycles 
is limited to 2°? — 1 (32 bit counter). The instructions is speculative and could be executed 
as a NOP by a given processor implementation. 


Any of the following events will cause the processor to start fetching instructions for the 
delayed thread again: the counter counting down to zero, an NMI or SMI, a debug excep- 
tion, amachine check exception, the BINIT# signal, the INIT# signal, or the RESET# signal. 
The instruction may exit prematurely due to any interrupt (e.g. an interrupt on another 
thread on the same core). 


This instruction must properly handle the case where the current clock count turns over. 
This can be accomplished by performing the subtraction shown below and treating the 
result as an unsigned number. 


This instruction should prevent the issuing of additional instructions on the issuing thread 
as soon as possible, to avoid the otherwise likely case where another instruction on the 
same thread that was issued 3 or 4 clocks later has to be killed, creating a pipeline bubble. 


If, on any given clock, all threads are non-runnable, then any that are non-runnable due 
to the execution of DELAY may or may not be treated as runnable threads. 


Notes about Intel® Xeon Phi” coprocessor implementation: 


¢ In Intel® Xeon Phi” coprocessor, the processor won't execute from a "delayed" thread 
before the delay counter has expired, even if there are non-runnable threads at any 
given point in time. 


Operation 


START_CLOCK = CURRENT_CLOCK_COUNT 
DELAY_SLOTS = SRC 
if (DELAY_SLOTS > OxFFFFFFFF) DELAY_SLOTS = OxFFFFFFFF 
while ( (CURRENT_CLOCK_COUNT - START_CLOCK) < DELAY_SLOTS ) 
{ 

*xavoid fetching/issuing from the current thread* 


} 
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Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm_delay_32 (unsigned int); 
void _mm_delay_64 (unsigned _int64); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If operand is a memory location. 
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LZCNT - Leading Zero Count 


630 


Opcode Instruction Description 
VEX.128.F3.0F WO BD /r_ Izcntr32,r32 Count the number of leading bits set to 0 in r32 (src), leaving the 


result in r32 (dst). 


VEX.128.F3.0FW1 BD /r_ l|zcntr64,r64 Count the number of leading bits set to 0 in r64 (src), leaving the 


result in r64 (dst). 


Description 


Counts the number of leading most significant zero bits in a source operand (second 
operand) returning the result into a destination (first operand). 


LZCNT is an extension of the BSR instruction. The key difference between LZCNT and BSR 
is that LZCNT provides operand size as output when source operand is zero, while in the 
case of BSR instruction, if source operand is zero, the content of destination operand are 
undefined. 


ZF flag is set when the most significant set bit is bit OSIZE-1. CF is set when the source 
has no set bit. 


Operation 


temp = OPERAND_SIZE - 1 


DEST = 0 
while( (temp >= 0) AND (SRC[temp] == 0) ) 
{ 
temp = temp - 1 
DEST = DEST + 1 
} 
if (DEST == OPERAND_SIZE) { 
CF = 1 
} else { 
CF = 0 
} 
if (DEST == 0) ZF = 1 
} else { 
ZF = 0 
} 
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Flags Affected 


¢ ZF flag is set to 1 in case of zero output (most significant bit of the source is set), and 


to 0 otherwise 
¢ CF flag is set to 1 if input was zero and cleared otherwise. 
e The PE OF AF and SF flags are set to 0 


Intel’ C/C++ Compiler Intrinsic Equivalent 


unsignedint _lzcnt_u32 (unsigned int); 
_int64 _lzcnt_u64 (unsigned _int64); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 


If second operand is a memory location. 
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POPCNT - Return the Count of Number of Bits Set to 1 


Opcode Instruction Description 


in r32 (dst). 


in r64 (dst). 


VEX.128.F3.0F WO B8 /r popcntr32,r32 Count the number of bits set to 1 in r32 (src), leaving the result 


VEX.128.F3.0FW1B8/r popcntr64,r64 Count the number of bits set to 1 in r64 (src), leaving the result 


Operation 
tmp = 0 
for (i=0; i<OPERAND_SIZE; i++) 
{ 
if(SRC[i] == 1) tmp = tmp + 1 
} 
DEST = tmp 
Flags Affected 


¢ The ZF flag is set according to the result (if SRC==0) 
e The OF SF AF, CF and PF flags are set to 0 


Intel’ C/C++ Compiler Intrinsic Equivalent 


unsigned int _mm_popcnt_u32 (unsigned int); 
_int64 _mm_popcnt_u6é4 (unsigned _ int64); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 
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If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If second operand is a memory location. 
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SPFLT - Set performance monitor filtering mask 
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Opcode Instruction Description 

VEX.128.F2.0F WO AE /6 — spflt r32 Set performance monitoring filtering mask using r32. 

VEX.128.F2.0RW1 AE /6 — spflt r64 Set performance monitoring filtering mask using r64. 
Description 


SPFLT enables/disables performance monitoring on the currently executing thread only 
based on the LSB value of the source. 


SPFLT instruction is a model specific instruction and is not part of Intel® Architecture. 
The bit(s) and register(s) modified are model-specific and may vary by processor imple- 
mentation. 


The PERF_SPFLT_CTRL model-specific register modified by SPFLT instruction may also 
be read / modified with the RDMSR / WRMSR instructions, when executing at privilege 
level 0. 


The PERF_SPFLT_CTRL MSR is thread specific. SPFLT execution moves LSB of source 
(EAX) into the USR_PREF bit (bit 63) in the PERF_SPFLT_CTRL MSR. The lower N bits, 
called CNTR_x_SPFLT_EN (bits N-1:0, 1 per counter), in PERF_SPFLT_CTRL MSR control 
whether the USR_PREF bit affects enabling of performance monitoring for the corre- 
sponding counter. 


SPFLT instruction does not modify the CNTR_x_SPFLT_EN bits, where as RDMSR and 
WRMSR read / modify all bits of the PERF_SPFLT_CTRL MSR. 


Enabling Performance countering 


On a per thread basis, a performance monitoring counter n is incremented if, and only if: 


1. PERF_GLOBAL_CTRL[n] is set to 1 

2. 1A32 PerfEvtSeln[22] is set to 1 (where 'n' is the enabled counter) 

3. PERF_SPFLT_CTRL[n] is set to 0, or, PERF_SPFLT_CTRL[63] (USR_PREF) is set to 1. 
4. The desired event is asserted for thread id T 
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MSR address’ Per-thread? Name 


2Fh Y PERF_GLOBAL_CTRL 
Bit 1: Enable IA32_PerfEvtSel1 
Bit 0: Enable IA32_PerfEvtSel0 


28h Y 1A32_PerfEvtSel0 
Bit 22: Enable counter 0 


29h Y 1A32_PerfEvtSel1 
Bit 22: Enable counter 1 


2Ch Y PERF_SPFLT_CTRL 
Bit 63: User Preference (USR_PREF). 
Bit 1: Counter 1 SPFLT Enable. Controls whether USR_PREF 
is used in enabling performance monitoring for counter 1 
Bit 0: Counter 0 SPFLT Enable. Controls whether USR_PREF 
is used in enabling performance monitoring for counter 0 


Operation 


(* i is the thread ID of the current executing thread *) 
PerfFilterMask[i] [0] = SRC[O]; 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm_spflt_32 (unsigned int); 
void _mm_spflt_64 (unsigned _ int64); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 
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64 bit Mode 
#UD If processor model does not implement SPFLT. 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If operand is a memory location. 
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TZCNT - Trailing Zero Count 


Opcode Instruction 
VEX.128.F3.0R WO BC /r  tzcnt r32, r32 


VEX.128.F3.0FW1BC/r_ tzcnt r64, r64 


Description 

Count the number of trailing bits set to 0 in r32 (src), leaving the 
result in r32 (dst). 

Count the number of trailing bits set to 0 in r64 (src), leaving the 
result in r64 (dst). 


Description 


Searches the source operand (second operand) for the least significant set bit (1 bit). Ifa 
least significant 1 bit is found, its bit index is stored in the destination operand; otherwise, 
the destination operand is set to the operand size. 


ZF flag is set when the least significant set bit is bit 0. CF is set when the source has no set 


bit. 


Operation 


index = 0 
if ( SRC[OPERAND_SIZE-1:0] 


{ 
DEST = OPERAND_SIZE 
CF = 1 

} 

else 

{ 
while(SRC[index] == 
{ 

index = index+1 

} 
DEST = index 
CF = 0 

} 

Flags Affected 


¢ The ZF is set according to the result 


e The CF is set if SRC is zero 


e The PE OF AF and SF flags are set to 0 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


unsignedint _tzcnt_u32 (unsigned int); 
_int64 _tzcnt_u64 (unsigned _int64); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If second operand is a memory location. 
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TZCNTI - Initialized Trailing Zero Count 


Opcode Instruction Description 
VEX.128.F2.0F WO BC /r_ tzcntir32,r32 Count the number of trailing bits set to 0 between r32 (dst) and 
r32 (src). 
VEX.128.F2.0FW1 BC /r_ tzcntir64,r64 Count the number of trailing bits set to 0 between r64 (dst) and 
r64 (src). 
Description 


Searches the source operand (second operand) for the least significant set bit (1 bit) 
greater than bit DEST (where DEST is the destination operand, the first operand). Ifaleast 
significant 1 bit is found, its bit index is stored in the destination operand ; otherwise, the 
destination operand is set to the operand size. The value of DEST is a signed offset from 
bit 0 of the source operand. Any negative DEST value will produce a search starting from 
bit 0, like TZCNT. Any DEST value equal to or greater than (OPERAND_SIZE-1) will cause 
the destination operand to be set to the operand size. 


This instruction allows continuation of searches through bit vectors without having to 
mask off each least significant 1-bit before restarting, as is required with TZCNT. 


The functionality of this instruction is exactly the same as for the TZCNT instruction, ex- 
cept that the search starts at bit DEST+1 rather than bit 0. 


CF is set when the specified index goes beyond the operand size or there is no set bit 
between the index and the MSB bit of the source. 


Operation 


// DEST is a signed operand, no overflow 
if (DEST[OSIZE-1:0] < 0) index = 0 
else index = DEST + 1 


if( ( index > OPERAND_SIZE-1 ) || ( SRC[OPERAND_SIZE-1:index] == 0 ) ) 


{ 
DEST = OPERAND_SIZE 
CF=1 
} 
else 
{ 
while(SRC[index] == 0) 
{ 
index = index+1 
} 
DEST = index 
CF=0 
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} 


Flags Affected 


e The ZF is set according to the result 


¢ The CFissetifSRC is zero betwen index and MSB, or index is greater than the operand 
size. 


e The PE OF AF and SF flags are set to 0 


Intel’ C/C++ Compiler Intrinsic Equivalent 


int _mm_tzcnti_32 (int, unsigned int); 
_int64 _mm _tzcnti_64 (_int64, unsigned _int64); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If second operand is a memory location. 
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VPREFETCHO - Prefetch memory line using TO hint 


Opcode Instruction Description 
VEX.128.0F 18 /1 vprefetchO m8 ___ Prefetch memory line in m8 using TO hint. 
MVEX.512.0F 18/1 vprefetchOm8  Prefetch memory line in m8 using TO hint. 


Description 


This is very similar to the existing IA-32 prefetch instruction, PREFETCHO, as described 
in IA-32 Intel® Architecture Software Developer's Manual: Volume 2. If the line selected is 
already present in the cache hierarchy at a level closer to the processor, no data movement 
occurs. Prefetches from uncacheable or WC memory are ignored. 


In contrast with the existing prefetch instruction, the MVEX form of this instruction uses 
disp8*64 addressing. Displacements that would normally be 8 bits according to the 
ModR/M byte are still 8 bits but scaled by 64 so that they have cache-line granularity. 
VEX forms of this instruction uses regular disp8 addressing. 


This instruction is a hint and may be speculative, and may be dropped or specify invalid 
addresses without causing problems or memory related faults. 


This instruction contains a set of hint attributes that modify the prefetching behavior: 


exclusive: make line Exclusive in the L1 cache (unless it's already Exclusive or Modified 
in the L1 cache). 

nthintpre (NTH): load data into the L1 nontemporal cache rather than the L1 temporal 
cache. Data will be loaded in the #TIDth way and made MRU. Data should still be 
cached normally in the L2 and higher caches. 


Note that in Intel® Xeon Phi” coprocessor, the hardware drops VPREFETCH if it hits L1 
(so it becomes transparent to L2). Consequently, this instructon is not a good solution 
to avoid hot L1/cold L2 performance problems. Prefetches set the access bit (A) in the 
related TLB page entry, but prefetches with exclusive access (RFO) do not set the dirty bit 


(D). 


PREFETCH Hint equivalence for the Intel® Xeon Phi” coprocessor 


Instruction Cache Level Non-temporal Bring as exclusive 
VPREFETCHO L1 NO NO 
VPREFETCHNTA L1 YES NO 

VPREFETCH1 L2 NO NO 
VPREFETCH2 L2 YES NO 
VPREFETCHEO L1 NO YES 
VPREFETCHENTA L1 YES YES 
VPREFETCHE1 L2 NO YES 
VPREFETCHE2 L2 YES YES 
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Operation 


exclusive = 0 
nthintpre = 0 
FetchLiCacheLine(effective_address, exclusive, nthintpre) 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm_prefetch (char const’, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If operand is not amemory location. 
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VPREFETCH1 - Prefetch memory line using T1 hint 


Opcode Instruction Description 
VEX.128.0F 18 /2 vprefetch1 m8 Prefetch memory line in m8 using T1 hint. 
MVEX.512.0F 18/2 vprefetchim8  Prefetch memory line in m8 using T1 hint. 


Description 


This is very similar to the existing IA-32 prefetch instruction, PREFETCHO, as described 
in IA-32 Intel® Architecture Software Developer's Manual: Volume 2. If the line selected is 
already present in the cache hierarchy at a level closer to the processor, no data movement 
occurs. Prefetches from uncacheable or WC memory are ignored. 


In contrast with the existing prefetch instruction, the MVEX form of this instruction uses 
disp8*64 addressing. Displacements that would normally be 8 bits according to the 
ModR/M byte are still 8 bits but scaled by 64 so that they have cache-line granularity. 
VEX forms of this instruction uses regular disp8 addressing. 


This instruction is a hint and may be speculative, and may be dropped or specify invalid 
addresses without causing problems or memory related faults. 


This instruction contains a set of hint attributes that modify the prefetching behavior: 


exclusive: make line Exclusive in the L2 cache (unless it's already Exclusive or Modified 
in the L2 cache). 

nthintpre (NTH): load data into the L2 nontemporal cache rather than the L2 temporal 
cache. Data will be loaded in the #TIDth way and made MRU. Data should still be 
cached normally in the L2 and higher caches. 


Note that in the Intel® Xeon Phi” coprocessor, the hardware drops VPREFETCH if it hits 
L1 (so it becomes transparent to L2). Consequently, this instructon is not a good solution 
to avoid hot L1/cold L2 performance problems. Prefetches set the access bit (A) in the 
related TLB page entry, but prefetches with exclusive access (RFO) do not set the dirty bit 


(D). 


PREFETCH Hint equivalence for the Intel® Xeon Phi” coprocessor 


Instruction Cache Level Non-temporal Bring as exclusive 
VPREFETCHO L1 NO NO 
VPREFETCHNTA L1 YES NO 

VPREFETCH1 L2 NO NO 
VPREFETCH2 L2 YES NO 
VPREFETCHEO L1 NO YES 
VPREFETCHENTA L1 YES YES 
VPREFETCHE1 L2 NO YES 
VPREFETCHE2 L2 YES YES 
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Operation 


exclusive = 0 
nthintpre = 0 
FetchL2CacheLine(effective_address, exclusive, nthintpre) 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm_prefetch (char const’, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If operand is not amemory location. 
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VPREFETCH2 - Prefetch memory line using T2 hint 


Opcode Instruction Description 
VEX.128.0F 18 /3 vprefetch2 m8 Prefetch memory line in m8 using T2 hint. 
MVEX.512.0F 18/3  vprefetch2 m8  Prefetch memory line in m8 using T2 hint. 


Description 


This is very similar to the existing IA-32 prefetch instruction, PREFETCHO, as described 
in IA-32 Intel® Architecture Software Developer's Manual: Volume 2. If the line selected is 
already present in the cache hierarchy at a level closer to the processor, no data movement 
occurs. Prefetches from uncacheable or WC memory are ignored. 


In contrast with the existing prefetch instruction, the MVEX form of this instruction uses 
disp8*64 addressing. Displacements that would normally be 8 bits according to the 
ModR/M byte are still 8 bits but scaled by 64 so that they have cache-line granularity. 
VEX forms of this instruction uses regular disp8 addressing. 


This instruction is a hint and may be speculative, and may be dropped or specify invalid 
addresses without causing problems or memory related faults. 


This instruction contains a set of hint attributes that modify the prefetching behavior: 


exclusive: make line Exclusive in the L2 cache (unless it's already Exclusive or Modified 
in the L2 cache). 

nthintpre (NTH): load data into the L2 nontemporal cache rather than the L2 temporal 
cache. Data will be loaded in the #TIDth way and made MRU. Data should still be 
cached normally in the L2 and higher caches. 


Note that in Intel® Xeon Phi” coprocessor, the hardware drops VPREFETCH if it hits L1 
(so it becomes transparent to L2). Consequently, this instructon is not a good solution 
to avoid hot L1/cold L2 performance problems. Prefetches set the access bit (A) in the 
related TLB page entry, but prefetches with exclusive access (RFO) do not set the dirty bit 


(D). 


PREFETCH Hint equivalence for the Intel® Xeon Phi” coprocessor 


Instruction Cache Level Non-temporal Bring as exclusive 
VPREFETCHO L1 NO NO 
VPREFETCHNTA L1 YES NO 

VPREFETCH1 L2 NO NO 
VPREFETCH2 L2 YES NO 
VPREFETCHEO L1 NO YES 
VPREFETCHENTA L1 YES YES 
VPREFETCHE1 L2 NO YES 
VPREFETCHE2 L2 YES YES 
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Operation 


exclusive = 0 
nthintpre = 1 
FetchL2CacheLine(effective_address, exclusive, nthintpre) 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm_prefetch (char const’, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If operand is not amemory location. 
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VPREFETCHEO - Prefetch memory line using TO hint, with intent to write 


VEX.128.0F 18 /5 
MVEX.512.0F 18 /5 


Opcode Instruction Description 
vprefetcheO m8 ___— Prefetch memory line in m8 using TO hint with intent to write. 
vprefetcheO m8 __Prefetch memory line in m8 using TO hint with intent to write. 


Description 


This is very similar to the existing IA-32 prefetch instruction, PREFETCHO, as described 
in IA-32 Intel® Architecture Software Developer's Manual: Volume 2. If the line selected is 
already present in the cache hierarchy at a level closer to the processor, no data movement 
occurs. Prefetches from uncacheable or WC memory are ignored. 


In contrast with the existing prefetch instruction, the MVEX form of this instruction uses 
disp8*64 addressing. Displacements that would normally be 8 bits according to the 
ModR/M byte are still 8 bits but scaled by 64 so that they have cache-line granularity. 
VEX forms of this instruction uses regular disp8 addressing. 


This instruction is a hint and may be speculative, and may be dropped or specify invalid 
addresses without causing problems or memory related faults. 


This instruction contains a set of hint attributes that modify the prefetching behavior: 


exclusive: make line Exclusive in the L1 cache (unless it's already Exclusive or Modified 
in the L1 cache). 

nthintpre (NTH): load data into the L1 nontemporal cache rather than the L1 temporal 
cache. Data will be loaded in the #TIDth way and made MRU. Data should still be 
cached normally in the L2 and higher caches. 


In Intel® Xeon Phi” coprocessor, the hardware drops VPREFETCH if it hits L1 (so it be- 
comes transparent to L2). Consequently, this instructon is not a good solution to avoid 
hot L1/cold L2 performance problems. Prefetches set the access bit (A) in the related 
TLB page entry, but prefetches with exclusive access (RFO) do not set the dirty bit (D). 


PREFETCH Hint equivalence for the Intel® Xeon Phi” coprocessor 


Instruction Cache Level Non-temporal Bring as exclusive 
VPREFETCHO L1 NO NO 
VPREFETCHNTA L1 YES NO 

VPREFETCH1 L2 NO NO 
VPREFETCH2 L2 YES NO 
VPREFETCHEO L1 NO YES 
VPREFETCHENTA L1 YES YES 
VPREFETCHE1 L2 NO YES 
VPREFETCHE2 L2 YES YES 
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Operation 


exclusive = 1 
nthintpre = 0 
FetchLiCacheLine(effective_address, exclusive, nthintpre) 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm_prefetch (char const’, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If operand is not amemory location. 
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VPREFETCHE1 - Prefetch memory line using T1 hint, with intent to write 


VEX.128.0F 18 /6 
MVEX.512.0F 18 /6 


Opcode Instruction Description 
vprefetche1 m8 _Prefetch memory line in m8 using T1 hint with intent to write. 
vprefetche1 m8 Prefetch memory line in m8 using T1 hint with intent to write. 


Description 


This is very similar to the existing IA-32 prefetch instruction, PREFETCHO, as described 
in IA-32 Intel® Architecture Software Developer's Manual: Volume 2. If the line selected is 
already present in the cache hierarchy at a level closer to the processor, no data movement 
occurs. Prefetches from uncacheable or WC memory are ignored. 


In contrast with the existing prefetch instruction, the MVEX form of this instruction uses 
disp8*64 addressing. Displacements that would normally be 8 bits according to the 
ModR/M byte are still 8 bits but scaled by 64 so that they have cache-line granularity. 
VEX forms of this instruction uses regular disp8 addressing. 


This instruction is a hint and may be speculative, and may be dropped or specify invalid 
addresses without causing problems or memory related faults. 


This instruction contains a set of hint attributes that modify the prefetching behavior: 


exclusive: make line Exclusive in the L2 cache (unless it's already Exclusive or Modified 
in the L2 cache). 

nthintpre (NTH): load data into the L2 nontemporal cache rather than the L2 temporal 
cache. The data will be loaded in the #TIDth way and making the data MRU. Data 
should still be cached normally in the L2 and higher caches. 


The hardware drops VPREFETCH if it hits L1 (so it becomes transparent to L2). Conse- 
quently, this instructon is not a good solution to avoid hot L1/cold L2 performance prob- 
lems. Prefetches set the access bit (A) in the related TLB page entry, but prefetches with 
exclusive access (RFO) do not set the dirty bit (D). 


PREFETCH Hint equivalence for the Intel® Xeon Phi” coprocessor 


Instruction Cache Level Non-temporal Bring as exclusive 
VPREFETCHO L1 NO NO 
VPREFETCHNTA L1 YES NO 

VPREFETCH1 L2 NO NO 
VPREFETCH2 L2 YES NO 
VPREFETCHEO L1 NO YES 
VPREFETCHENTA L1 YES YES 
VPREFETCHE1 L2 NO YES 
VPREFETCHE2 L2 YES YES 
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Operation 


exclusive = 1 
nthintpre = 0 
FetchL2CacheLine(effective_address, exclusive, nthintpre) 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm_prefetch (char const’, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If operand is not amemory location. 
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VPREFETCHE2 - Prefetch memory line using T2 hint, with intent to write 


VEX.128.0F 18 /7 
MVEX.512.0F 18 /7 


Opcode Instruction Description 
vprefetche2 m8 _Prefetch memory line in m8 using T2 hint with intent to write. 
vprefetche2 m8 _Prefetch memory line in m8 using T2 hint with intent to write. 


Description 


This is very similar to the existing IA-32 prefetch instruction, PREFETCHO, as described 
in IA-32 Intel® Architecture Software Developer's Manual: Volume 2. If the line selected is 
already present in the cache hierarchy at a level closer to the processor, no data movement 
occurs. Prefetches from uncacheable or WC memory are ignored. 


In contrast with the existing prefetch instruction, the MVEX form of this instruction uses 
disp8*64 addressing. Displacements that would normally be 8 bits according to the 
ModR/M byte are still 8 bits but scaled by 64 so that they have cache-line granularity. 
VEX forms of this instruction uses regular disp8 addressing. 


This instruction is a hint and may be speculative, and may be dropped or specify invalid 
addresses without causing problems or memory related faults. 


This instruction contains a set of hint attributes that modify the prefetching behavior: 


exclusive: make line Exclusive in the L2 cache (unless it's already Exclusive or Modified 
in the L2 cache). 

nthintpre (NTH): load data into the L2 nontemporal cache rather than the L2 temporal 
cache. Data will be loaded in the #TIDth way and made MRU. Data should still be 
cached normally in the L2 and higher caches. 


Note that in Intel® Xeon Phi” coprocessor, the hardware drops VPREFETCH if it hits L1 
(so it becomes transparent to L2). Consequently, this instructon is not a good solution 
to avoid hot L1/cold L2 performance problems. Prefetches set the access bit (A) in the 
related TLB page entry, but prefetches with exclusive access (RFO) do not set the dirty bit 


(D). 


PREFETCH Hint equivalence for the Intel® Xeon Phi” coprocessor 


Instruction Cache Level Non-temporal Bring as exclusive 
VPREFETCHO L1 NO NO 
VPREFETCHNTA L1 YES NO 

VPREFETCH1 L2 NO NO 
VPREFETCH2 L2 YES NO 
VPREFETCHEO L1 NO YES 
VPREFETCHENTA L1 YES YES 
VPREFETCHE1 L2 NO YES 
VPREFETCHE2 L2 YES YES 
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Operation 


exclusive = 1 
nthintpre = 1 
FetchL2CacheLine(effective_address, exclusive, nthintpre) 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm_prefetch (char const’, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If operand is not amemory location. 
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VPREFETCHENTA - Prefetch memory line using NTA hint, with intent to 


write 


VEX.128.0F 18 /4 
MVEX.512.0F 18 /4 


Opcode Instruction Description 
vprefetchentam8  Prefetch memory line in m8 using NTA hint with intent to write. 
vprefetchentam8  Prefetch memory line in m8 using NTA hint with intent to write. 


Description 


This is very similar to the existing IA-32 prefetch instruction, PREFETCHO, as described 
in IA-32 Intel® Architecture Software Developer's Manual: Volume 2. If the line selected is 
already present in the cache hierarchy at a level closer to the processor, no data movement 
occurs. Prefetches from uncacheable or WC memory are ignored. 


In contrast with the existing prefetch instruction, this instruction uses disp8*64 address- 
ing. Displacements that would normally be 8 bits according to the ModR/M byte are still 
8 bits but scaled by 64 so that they have cache-line granularity. 


This instruction is a hint and may be speculative, and may be dropped or specify invalid 
addresses without causing problems or memory related faults. 


This instruction contains a set of hint attributes that modify the prefetching behavior: 


exclusive: make line Exclusive in the L1 cache (unless it's already Exclusive or Modified 
in the L1 cache). 

nthintpre (NTH): load data into the L1 nontemporal cache rather than the L1 temporal 
cache. The data will be loaded in the #TIDth way and making the data MRU. Data 
should still be cached normally in the L2 and higher caches. 


The hardware drops VPREFETCH if it hits L1 (so it becomes transparent to L2). Conse- 
quently, this instructon is not a good solution to avoid hot L1/cold L2 performance prob- 
lems. Prefetches set the access bit (A) in the related TLB page entry, but prefetches with 
exclusive access (RFO) do not set the dirty bit (D). 


PREFETCH Hint equivalence for the Intel® Xeon Phi” coprocessor 


Instruction Cache Level Non-temporal Bring as exclusive 
VPREFETCHO L1 NO NO 
VPREFETCHNTA L1 YES NO 

VPREFETCH1 L2 NO NO 
VPREFETCH2 L2 YES NO 
VPREFETCHEO L1 NO YES 
VPREFETCHENTA L1 YES YES 
VPREFETCHE1 L2 NO YES 
VPREFETCHE2 L2 YES YES 
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Operation 


exclusive = 1 
nthintpre = 1 
FetchLiCacheLine(effective_address, exclusive, nthintpre) 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm_prefetch (char const’, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If operand is not amemory location. 
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VPREFETCHNTA - Prefetch memory line using NTA hint 


Opcode Instruction Description 
VEX.128.0F 18 /0 vprefetchntam8  Prefetch memory line in m8 using NTA hint. 
MVEX.512.0F 18/0 vprefetchntam8  Prefetch memory line in m8 using NTA hint. 


Description 


This is very similar to the existing IA-32 prefetch instruction, PREFETCHO, as described 
in IA-32 Intel® Architecture Software Developer's Manual: Volume 2. If the line selected is 
already present in the cache hierarchy at a level closer to the processor, no data movement 
occurs. Prefetches from uncacheable or WC memory are ignored. 


In contrast with the existing prefetch instruction, the MVEX form of this instruction uses 
disp8*64 addressing. Displacements that would normally be 8 bits according to the 
ModR/M byte are still 8 bits but scaled by 64 so that they have cache-line granularity. 
VEX forms of this instruction uses regular disp8 addressing. 


This instruction is a hint and may be speculative, and may be dropped or specify invalid 
addresses without causing problems or memory related faults. 


This instruction contains a set of hint attributes that modify the prefetching behavior: 


exclusive: make line Exclusive in the L1 cache (unless it's already Exclusive or Modified 
in the L1 cache). 

nthintpre (NTH): load data into the L1 nontemporal cache rather than the L1 temporal 
cache. Data will be loaded in the #TIDth way and made MRU. Data should still be 
cached normally in the L2 and higher caches. 


In Intel® Xeon Phi” coprocessor, the hardware drops VPREFETCH if it hits L1 (so it be- 
comes transparent to L2). Consequently, this instructon is not a good solution to avoid 
hot L1/cold L2 performance problems. Prefetches set the access bit (A) in the related 
TLB page entry, but prefetches with exclusive access (RFO) do not set the dirty bit (D). 


PREFETCH Hint equivalence for the Intel® Xeon Phi” coprocessor 


Instruction Cache Level Non-temporal Bring as exclusive 
VPREFETCHO L1 NO NO 
VPREFETCHNTA L1 YES NO 

VPREFETCH1 L2 NO NO 
VPREFETCH2 L2 YES NO 
VPREFETCHEO L1 NO YES 
VPREFETCHENTA L1 YES YES 
VPREFETCHE1 L2 NO YES 
VPREFETCHE2 L2 YES YES 
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Operation 


exclusive = 0 
nthintpre = 1 
FetchLiCacheLine(effective_address, exclusive, nthintpre) 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm_prefetch (char const’, int); 


Exceptions 


Real-Address Mode and Virtual-8086 


#UD Instruction not available in these modes 


Protected and Compatibility Mode 


#UD Instruction not available in these modes 


64 bit Mode 


If preceded by any REX, FO, F2, F3, or 66 prefixes. 
If operand is not amemory location. 
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Appendix B 


Intel Xeon Phi. coprocessor 64 bit Mode 
Scalar Instruction Support 


In 64 bit mode, the Intel® Xeon Phi” coprocessor supports a subset of the Intel 64 Architecture instructions. The 


64 bit mode instructions supported by the Intel® Xeon Phi” coprocessor are listed in this chapter. 


B.1 64 bit Mode General-Purpose and X87 Instructions 


Intel® Xeon Phi” coprocessor supports most of the general-purpose register (GPR) and X87 instructions in 64 
bit mode. They are listed in Table B.2. 


64 bit Mode GPR and X87 Instructions in the Intel® Xeon Phi’ coprocessor: 


ADC ADD AND BSF BSR 
BSWAP BT BTC BTR BTS 
CALL CBW CDQ CDQE CLC 
CLD CLI CLTS CMC CMP 
CMPS CMPSB CMPSD CMPSQ CMPSW 
CMPXCHG | CMPXCHG8B | CPUID CQO CWD 
CWDE DEC DIV ENTER F2XM1 
FABS FADD FADDP FBLD FBSTP 
FCHS FCLEX FCOM FCOMP FCOMPP 
FCOS FDECSTP FDIV FDIVP FDIVR 
FDIVRP FFREE FIADD FICOM FICOMP 
FIDIV FIDIVR FILD FIMUL FINCSTP 
FINIT FIST FISTP FISUB FISUBR 
FLD FLD1 FLDCW FLDENV | FLDL2E 
FLDL2T FLDLG2 FLDLN2 FLDPI FLDZ 
FMUL FMULP FNCLEX FNINIT FNOP 
FNSAVE FNSTCW FNSTENV | FNSTSW_ | FPATAN 
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FPREM FPREM1 FPTAN FRNDINT | FRESTOR 
FSAVE FSCALE FSIN FSINCOS | FSQRT 
FST FSTCW FSTENV | FSTP FSTSW 
FSUB FSUBP FSUBR FSUBRP | FTST 
FUCOM FUCOMP FUCOMPP | FWAIT FXAM 
FXCH FXRSTOR FXSAVE | FXTRACT | FYL2X 
FYL2XP1_ | HLT IDIV IMUL INC 
INT INT3 INTO INVD INVPLG 
IRET TRETD JA JAE JB 

JBE Ic JCXZ JE JECXZ 
i¢ JGE JL JLE JMP 
JNA JNAE JNB JNBE JNC 
JNE JNG JNGE JNL JNLE 
JNO JNP JNS JNZ jo 

JP JPE JPO Js [Z 
LAHF LAR LEA LEAVE LFS 
LGDT LGS LIDT LLDT LMSW 
LOCK LODS LODSB LODSD | LODSQ 
LODSW | LOOP LOOPE LOOPNE | LOOPNZ 
LOOPZ LSL LSS LTR MOV 
MOVCR | MOVDR Movs MOVSB | MOVSD 
MOovsQ. | MOVSW MOVSX MOVSXD | MOVZX 
MUL NEG NOP NOT OR 
POP POPF POPFQ PUSH PUSHF 
PUSHFQ | RCL RCR RDMSM | RDPMC 
RDTSC REP REPE REPNE | REPNZ 
RET ROL ROR RSM SAHF 
SAL SAR SBB SCAS SCASB 
SCASD SCASQ SCASW SETA SETAE 
SETB SETBE SETC SETE SETG 
SETGE SETL SETLE SETNA | SETNAE 
SETNB SETNBE SETNC SETNE SETNG 
SETNGE | SETNL SETNLE | SETNO | SETNP 
SETNS SETNZ SETO SETP SETPE 
SETPO SETS SETZ SGDT SHL 
SHLD SHR SHRD SIDT SLDT 
SMSW STC STD STI STOSB 
STOSD STOSQ STOSW STR SUB 
SWAPGS | SYSCALL SYSRET | TEST VERR 
VERW WAIT WBINVD | WRMSR | XADD 
XCHG XLAT XLATB XOR UD2 
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B.2 Intel’ Xeon Phi coprocessor 64 bit Mode Limitations 


In 64 bit mode, the Intel® Xeon Phi” coprocessor supports a subset of the Intel 64 Architecture instructions. 
The following summarizes Intel 64 Architecture instructions that are not supported in the Intel® Xeon Phi™ 


coprocessor: 


¢ Instructions that operate on MMX registers 


e Instructions that operate on XMM registers 


e Instructions that operate on YMM registers 


GPR and X87 Instructions Not Supported in the Intel® Xeon Phi” coprocessor 


CMOV CMPXCHG16B | FCMOVcc | FCOMI 
FCOMIP FUCOMI FUCOMIP | IN 
INS INSB INSD INSW 
MONITOR | MWAIT OUT OUTS 
OUTSB OUTSD OUTSW PAUSE 
SYSENTER | SYSEXIT 


Reference Number: 327364-001 


659 


> 
D 


APPENDIX B. INTEL XEON PHI” COPROCESSOR 64 BIT MODE SCALAR INSTRUCTION SUPPORT 


B.3_ LDMXCSR - Load MXCSR Register 


Opcode Instruction Description 
OFAE/2 lIdmxcsrm32 Load MXCSR register from m32 


Description 


Loads the source operand into the MXCSR control/status register. The source operand is 
a 32 bit memory location. See MXCSR Control and Status Register in Chapter 10, of the 
JA-32 Intel Architecture Software Developers Manual, Volume 1, for a description of the 
MXCSR register and its contents. See chapter 3 of this document for a description of the 
new Intel® Xeon Phi” coprocessor's MXCSR feature bits. 


The LDMXCSR instruction is typically used in conjunction with the STMXCSR instruction, 
which stores the contents of the MXCSR register in memory. 


The default MXCSR value at reset is 0020_0000H (DUE=1, FZ=0, RC=00, PM=0, UM=0, 
OM=0, ZM=0, DM=0, IM=0, DAZ=0, PE=0, UE=0, OE=0, ZE=0, DE=0, IE=0). 


Any attempt to set to 1 reserved bits in control register MXCSR will produce a #GP fault: 


Bit default Comment 
MXCSR[7-12] 0 Note that this corresponds to Intel® SSE's IM/DM/ZM/OM/UM/PM 
MXCSR[16-20] 0 Reserved 
MXCSR[22-31] 0 Reserved 


Additionally, any attempt to set MXCSR.DUE (bit 21) to 0 will produce a #GP fault: 


Bit default Comment 
MXCSR[21] 1 DUE (Disable Unmasked Exceptions) always enforced in Intel® Xeon Phi’ coprocessor 


This instructions operation is the same in non-64 bit modes and 64 bit mode. 


Operation 


MXCSR = MemLoad(m32) 


Flags Affected 


None. 
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Intel’ C/C++ Compiler Intrinsic Equivalent 


void _mm_setcsr (unsigned int) 


Exceptions 
#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 
#GP(0) If the memory address is in a non-canonical form. 


For an attempt to set reserved bits in MXCSR 
#PF(fault-code) For a page fault. 
#NM If CRO.TS[bit 3] = 1. 
#UD If CRO.EM[bit 2] = 1. 
If CS.L=0 or [A32_EFER.LMA=0. 
If the lock prefix is used. 
#AC(0) If alignment checking is enabled and an unaligned 
memory reference is made while the current privilege 
level is 3. 
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Opcode Instruction Description 
OF AE /1 fxrstor m512byte Restore the x87 FPU and MXCSR register state from m512byte 
REX.W+0F AE /1_ fxrstor64m512byte Restore the x87 FPU with 64-bit FPU-DP and MXCSR register state 


from m512byte 


Description 


See Intel64® Intel® Architecture Software Developer's Manual for the description of the 
original x86 instruction. 


Reloads the x87 FPU and the MXCSR state from the 512-byte memory image specified 
in the source operand. This data should have been written to memory previously using 
the FXSAVE instruction of the Intel® Xeon Phi” coprocessor , and in the same format as 
required by the operating modes. The first byte of the data should be located on a 16-byte 
boundary. There are three distinct layout of the FXSAVE state map: one for legacy and 
compatibility mode, a second format for 64 bit mode with promoted operandsize, and the 
third format is for 64 bit mode with default operand size. 


Intel® Xeon Phi” coprocessor follows the same layouts as described in Intel64® Intel® 
Architecture Software Developer's Manual. 


The state image referenced with an FXRSTOR instruction must have been saved using an 
FXSAVE instruction or be in the same format as required by the reference pages of FXSAVE 
/ FXRSTORE instruction of the Intel® Xeon Phi” coprocessor. Referencing a state image 
saved with an FSAVE, FNSAVE instruction or incompatible field layout will result in an 
incorrect state restoration. 


The FXRSTOR instruction does not flush pending x87 FPU exceptions. To check and raise 
exceptions when loading x87 FPU state information with the FXRSTOR instruction, use an 
FWAIT instruction after the FXRSTOR instruction. 


The coprocessor will enforce the XMM state save area must be zero, otherwise a #GP will 
be raised. The coprocessor does not use the content of the MXCSR_MASK field. The co- 
processor will clear bits 0:127 of the ZMM state. 


Any attempt to set reserved bits in control register MXCSR to 1 will produce a #GP fault: 


Bit default Comment 
MXCSR[7-12] 0 Note that this corresponds to Intel® SSE's IM/DM/ZM/OM/UM/PM 
MXCSR[16-19] 0 Reserved 
MXCSR[20] 0 Reserved 
MXCSR[22-31] 0 Reserved 


Additionally, any attempt to set MXCSR.DUE (bit 21) to 0 will produce a #GP fault: 
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Bit default Comment 
MXCSR[21] 1 DUE (Disable Unmasked Exceptions) always enforced in Intel® Xeon Phi’ coprocessor 
Operation 


// Clear bits [0:127] of ZMM states, enforce XMM state save area must be zero, ignore MXCSR_MA‘ 
(x87 FPU, MXCSR) = MemLoad(SRC) ; 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _fxrstor64 (void*); 


Exceptions 

#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 

#GP(0) If the memory address is in a non-canonical form. 
If memory operand is not aligned on a 16-byte boundary, 
regardless of segment. 
If trying to set illegal MXCSR values. 

#MF If there is a pending x87 FPU exception. 

#PF(fault-code) For a page fault. 

#UD If CPUID.01H:EDX.FXSR[bit 24] = 0. 
If instruction is preceded by a LOCK prefix. 

#NM If CRO.TS[bit 3] = 1. 
If CRO.EM[bit 2] = 1. 

#AC If this exception is disabled a general protection exception 


(#GP) is signaled if the memory operand is not aligned ona 
16-byte boundary, as described above. If the alignment check 
exception (#AC) is enabled (and the CPL is 3), signaling of 
#AC is not guaranteed and may vary with implementation, as 
follows. In all implementations where #AC is not signaled, a 
general protection exception is signaled in its place. In 
addition, the width of the alignment check may also vary with 
implementation. For instance, for a given implementation, 

an alignment check exception might be signaled for a 2-byte 
misalignment, whereas a general protection exception might 
be signaled for all other misalignments (4-, 8-, or 16-byte 
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B.5 FXSAVE - Save x87 FPU and MXCSR State 


Opcode Instruction Description 
OFAE/0O  fxsavem512byte Save the x87 FPU and MXCSR register state to m512byte 


Description 


See Intel64® Intel® Architecture Software Developer's Manual for the description of the 
original x86 instruction. 


Saves the current state of the x87 FPU and the relevant state in the MXCSR register to a 
512-byte memory location specified in the destination operand. The content layout of the 
512 byte region depends on whether the processor is operating in non- 64 bit operating 
modes or 64 bit sub-mode of IA-32e mode. 


Bytes 464:511 are available to software use. The processor does not write to bytes 
464:511 of an FXSAVE area. 


Intel® Xeon Phi” coprocessor follows a similar layout as described in Intel64® Intel® Ar- 
chitecture Software Developer's Manual. 


The processor will write 0s to the MXCSR_MASK field and the XMM state save area. The 
processor does not save any portion of the ZMM register states into the FXSAVE state save 
area. 


Operation 


if (64 bit Mode) 
{ 
if (REX.W == 1) 
{ 
// clear MXCSR_MASK field and XMM save area 
MemStore(m512byte) = Save64BitPromotedFxsave(x87 FPU, MXCSR); 
} 
else { 
// clear MXCSR_MASK field and XMM save area 
MemStore(m512byte) = Save64BitDefaultFxsave(x87 FPU, MXCSR); 
} 
} 
else { 
// clear MXCSR_MASK field and XMM save area 
MemStore(m512byte) = SaveLegacyFxsave(x87 FPU, MXCSR) ; 
} 
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Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


void _fxsave64 (void*); 


Exceptions 

#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 

#GP(0) If the memory address is in a non-canonical form. 
If memory operand is not aligned on a 16-byte boundary, 
regardless of segment. 

#MF If there is a pending x87 FPU exception. 

#PF(fault-code) For a page fault. 

#UD If CPUID.01H:EDX.FXSR[bit 24] = 0. 
If instruction is preceded by a LOCK prefix. 

#NM If CRO.TS[bit 3] = 1. 
If CRO.EM[bit 2] = 1. 

#AC If this exception is disabled a general protection exception 


(#GP) is signaled if the memory operand is not aligned ona 
16-byte boundary, as described above. If the alignment check 
exception (#AC) is enabled (and the CPL is 3), signaling of 
#AC is not guaranteed and may vary with implementation, as 
follows. In all implementations where #AC is not signaled, a 
general protection exception is signaled in its place. In 
addition, the width of the alignment check may also vary with 
implementation. For instance, for a given implementation, 

an alignment check exception might be signaled for a 2-byte 
misalignment, whereas a general protection exception might 
be signaled for all other misalignments (4-, 8-, or 16-byte 
misalignments). 
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B.6 RDPMC - 


Read Performance-Monitoring Counters 


Opcode Instruction Description 
OF 33 rdpmc Read 


performance- 
monitoring 
counter 
speci- 

fied by 

ECX 

into 
EDX:EAX. 


Description 


Loads the 40-bit performance-monitoring counter specified in the ECX register into reg- 
isters EDX:EAX. The EDX register is loaded with the high-order 8 bits of the counter and 
the EAX register is loaded with the low-order 32 bits. The counter to be read is specified 
with an unsigned integer placed in the ECX register. 


Intel® Xeon Phi” coprocessor has 2 performance monitoring counters per thread, speci- 
fied with 0000H through 0001H, respectively, in the ECX register. 


When in protected or virtual 8086 mode, the performance-monitoring counters enabled 
(PCE) flag in register CR4 restricts the use of the RDPMC instruction as follows. When the 
PCE flag is set, the RDPMC instruction can be executed at any privilege level; when the flag 
is clear, the instruction can only be executed at privilege level 0. (When in real-address 
mode, the RDPMC instruction is always enabled.) 


The performance-monitoring counters can also be read with the RDMSR instruction, 
when executing at privilege level 0. 


The performance-monitoring counters are event counters that can be programmed to 
count events such as the number of instructions decoded, number of interrupts received, 
or number of cache loads. Appendix A, Performance-Monitoring Events, in the IA-32 
Intel® Architecture Software Developers Manual, Volume 3, lists the events that can be 
counted for the Intel® Pentium® 4, Intel Xeon®, and earlier IA-32 processors. 


The RDPMC instruction is not a serializing instruction; that is, it does not imply that all the 
events caused by the preceding instructions have been completed or that events caused 
by subsequent instructions have not begun. If an exact event count is desired, software 
must insert a serializing instruction (such as the CPUID instruction) before and/or after 
the RDPMC instruction. 


The RDPMC instruction can execute in 16 bit addressing mode or virtual-8086 mode; 
however, the full contents of the ECX register are used to select the counter, and the event 
count is stored in the full EAX and EDX registers. 
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The RDPMC instruction was introduced into the IA-32 Architecture in the Intel® Pentium® 
Pro processor and the Intel® Pentium® processor with Intel® MMX™ technology. The ear- 
lier Intel® Pentium® processors have performance-monitoring counters, but they must be 
read with the RDMSR instruction. 


In 64 bit mode, RDPMC behavior is unchanged from 32 bit mode. The upper 32 bits of 
RAX and RDX are cleared. 


Operation 


if ( ( (ECX[31:0] >= 0) && (ECX[31:0] < 2) 
&& ((CR4.PCE = 1) || (CPL = 0) || (CRO.PE = 0)) 
) 


{ 
if (64 bit Mode) 
{ 
RAX[31:0] = PMC(ECX[31:0]) [31:0]; (* 40-bit read *) 
RAX [63:32] = 0; 
RDX[31:0] = PMC(ECX[31:0]) [39:32]; 
RDX [63:32] = 0; 
} 
else 
{ 
EAX = PMC(ECX[31:0]) [31:0]; (* 40-bit read *) 
EDX = PMC(ECX[31:0]) [39:32]; 
} 
} 
else 
{ 
#GP (0) 
} 
Flags Affected 
None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


_int64 _rdpmc (int); 
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Exceptions 


TBD 


Reference Number: 327364-001 669 


APPENDIX B. INTEL XEON PHI” COPROCESSOR 64 BIT MODE SCALAR INSTRUCTION SUPPORT 


> 
D 


B.7 STMXCSR - Store MXCSR Register 


670 


Opcode Instruction __ Description 
OFAE/3 stmxcsrm32 _ Store contents of MXCSR register to m32 


Description 


Stores the contents of the MXCSR control and status register to the destination operand. 


The destination operand is a 32 bit memory location. 


This instructions operation is the same in non-64 bit modes and 64 bit mode. 


Operation 


MemStore(m32) = MXCSR 


Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


unsigned int _mm_getcsr (void) 


Exceptions 

#SS(0) If a memory address referencing the SS segment is 
in a non-canonical form. 

#GP(0) If the memory address is in a non-canonical form. 

#PF(fault-code) For a page fault. 

#NM If CRO.TS[bit 3] = 1. 

#UD If CRO.EM[bit 2] = 1. 
If CS.L=0 or [A32_EFER.LMA=0. 
If the lock prefix is used. 

#AC(0) If alignment checking is enabled and an unaligned 
memory reference is made while the current privilege 
level is 3. 
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B.8 CPUID - CPUID Identification 


Opcode Instruction Description 
OF A2 cpuid Returns processor identification and feature information to the EAX, EBX, ECX, and 
EDX registers, as determined by the input value entered in EAX. 


Description 


The ID flag (bit 21) in the EFLAGS register indicates support for the CPUID instruction. If 
a software procedure can set and clear this flag, the processor executing the procedure 
supports the CPUID instruction. This instruction operates the same in non-64 bit modes 
and 64 bit mode. 


CPUID returns processor identification and feature information in the EAX, EBX, ECX, and 
EDX registers. The instructions output is dependent on the contents of the EAX register 
upon execution. For example, the following pseudo-code loads EAX with 00H and causes 
CPUID to return a Maximum Return Value and the Vendor Identification String in the ap- 
propriate registers: 


MOV EAX, OOH 
CPUID 


Table B.4 through B.7 shows information returned, depending on the initial value loaded 
into the EAX register. Table B.3 shows the maximum CPUID input value recognized for 
each family of IA-32 processors on which CPUID is implemented. Since Intel® Pentium® 
4 family of processors, two types of information are returned: basic and extended function 
information. Prior to that, only the basic function information was returned. The first is 
accessed with EAX=0000000xh while the second is accessed with EAX=8000000xh. Ifa 
value is entered for CPUID.EAX that is invalid for a particular processor, the data for the 
highest basic information leaf is returned. 


CPUID can be executed at any privilege level to serialize instruction execution. Serializing 
instruction execution guarantees that any modifications to flags, registers, and memory 
for previous instructions are completed before the next instruction is fetched and exe- 
cuted. 


INPUT EAX = 0: Returns CPUID's Highest Value for Basic Processor Information and 
the Vendor Identification String 


When CPUID executes with EAX set to 0, the processor returns the highest value the CPUID 
recognizes for returning basic processor information. The value is returned in the EAX 
register (see Table B.4 and is processor specific. A vendor identification string is also 
returned in EBX, EDX, and ECX. For Intel® processors, the string is "GenuinelIntel" and is 
expressed: 


EBX = 756e6547h (* "Genu", with G in the low nibble of BL *) 
EDX = 49656e69h (* "ineI", with i in the low nibble of DL *) 
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IA-32 Processors Highest Value in EAX 
Basic Information Extended Function In- 
formation 
Earlier Intel486 Processors CPUID Not Imple- CPUID Not Imple- 
mented mented 
Later Intel486 Processors and | 01H Not Implemented 
Intel® Pentium® Processors 
Intel® Pentium® Pro and Intel® | 02H Not Implemented 
Pentium® II Processors, Intel® 
Celeron Processors 
Intel® Pentium® III Processors 03H Not Implemented 
Intel® Pentium® 4 Processors 02H 80000004H 
Intel® Xeon® Processors 02H 80000004H 
Intel® Pentium® M Processor 02H 80000004H 
Intel® Pentium® 4 Processor sup- | 05H 80000008H 
porting Intel® Hyper-Threading 
Technology 
Intel® Pentium® D Processor | 05H 80000008H 
(8xx) 
Intel® Pentium® D Processor | 06H 80000008H 
(9xx) 
Intel® Core™ Duo Processor OAH 80000008H 
Intel® Core” 2 Duo Processor OAH 80000008H 
Intel® Xeon® Processor 3000, | OAH 80000008H 
3200, 5100, 5300 Series 
Intel® Xeon Phi” coprocessor 04H 80000008H 


Table B.3: Highest CPUID Source Operand for IA-32 Processors 


ECX = 6c65746eh (* "ntel", with n in the low nibble of CL *) 


INPUT EAX = 1: Returns Model, Family, Stepping Information 


When CPUID executes with EAX set to 1, version information is returned in EAX. Extended 
family, extended model, model, family, and processor type for Intel® Xeon Phi” coproces- 
sor is as follows: 


e Extended Model: 0000B 

e Extended Family: 0000_0000B 
¢ Model: *see table* 

e Family: 1011B 

e Processor Type: 00B 


INPUT EAX = 1: Returns Additional Information in EBX 


When CPUID executes with EAX set to 1, additional information is returned to the EBX 
register: 


e Brand index (low byte of EBX) - this number provides an entry into a brand string 


table that contains brand strings for IA-32 processors. More information about this 
field is provided later in this section. 
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EAX Information Provided about the Processor 
Basic CPUID Information 
H EAX Maximum Input Value for Basic CPUID Information 1 
EBX "Genu" "Genu" 
ECX "ntel" "ntel" 
EDX = “inel" "inel" 
Basic and Extended Feature Information 
1H 
EAX Version Information: Type, Family, Model, and Stepping 
ID 
Bits 3-0: Stepping Id XXXX 
Bits 7-4: Model 0001B 
Bits 11-8: Family ID 1011B 
Bits 13-12: Type 00B 
Bits 19-16: Extended Model Id 00B 
Bits 27-20: Extended Family Id 00000000B 
EBX _ Bits 7-0: Brand Index 0 
Bits 15-8: CLFLUSH/CLEVICTn line size (Value x 8 = cache | 8 
line size in bytes) 
Bits 23-16: Maximum number of logical processorsinthis | 248 
physical package. 
Bits 31-24: Initial APIC ID XXX 
ECX Extended Feature Information (see Tables B.10) 00000000H 
EDX _ Feature Information (see Tables B.8 and B.9) 110193FFH 
Cache and TLB Information 
2H EAX _ Reserved 0 
EBX _ Reserved 0 
ECX Reserved 0 
EDX _ Reserved 0 
Serial Number Information 
3H EAX _ Reserved 0 
EBX _ Reserved 0 
ECX Reserved 0 
EDX _ Reserved 0 


Table B.4: Information Returned by CPUID Instruction 


e CLFLUSH/CLEVICTn instruction cache line size (second byte of EBX) - this number 
indicates the size of the cache line flushed with CLEVICT1 instruction in 8-byte incre- 


ments. This field was introduced in the Intel® Pentium® 4 processor. 


¢ Local APIC ID (high byte of EBX) - this number is the 8-bit ID that is assigned to the 
local APIC on the processor during power up. This field was introduced in the Intel® 


Pentium® 4 processor. 


INPUT EAX = 1: Returns Feature Information in ECX and EDX 


When CPUID executes with EAX set to 1, feature information is returned in ECX and EDX. 
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EAX Information Provided about the Processor Return value 


CPUID leaves > 3 < 80000000 are visible only when 
IA32_MISC_LENABLES.BOOT_NT4 [bit 22] = 0 (default). 


Deterministic Cache Parameters Leaf ECX=0/1/2 


Note: 04H output also depends on the inital value in ECX. 


EAX _ Bits 4-0: Cache Type (0 = Null - No more caches; 1 = Data Cache | 2/1/1 
2 = Instruction Cache, 3 = Unified Cache) 


Bits 7-5: Cache Level (starts at 1) 1/1/2 
Bits 8: Self Initializing cache level (does not need SW initializa- | 1/1/1 
tion) 

Bits 9: Fully Associative cache 0/0/0 
Bits 10: Write-Back Invalidate 0/1/1 
Bits 11: Inclusive (of lower cache levels) 0/1/1 
Bits 13-12: Reserved 0 


Bits 25-14: Maximum number of threads sharing this cache ina | */*/* 
physical package (minus one) 
Bits 31-26: Maximum number of processor cores in this physical | */*/* 
package (minus one) 


EBX _ Bits 11-00: L = System Coherency Line Size (minus 1) 63/63/63 
Bits 21-12: P = Physical Line partitions (minus 1) 0/0/0 
Bits 31-22: W = Ways of associativity (minus 1) 7/7/7 
ECX S=Number of Sets (minus 1) 63/63/1023 
EDX _ Reserved = 0 0 


Table B.5: Information Returned by CPUID Instruction (Contd.) 


¢ Table B.8 through Table B.9 show encodings for EDX. 
¢ Table B.10 show encodings for ECX. 


For all feature flags, a 1 indicates that the feature is supported. Use Intel® to properly 
interpret feature flags. 


INPUT EAX = 2: Cache and TLB Information Returned in EAX, EBX, ECX, EDX 


Intel® Xeon Phi” coprocessor considers leaf 2 to be reserved, so no cache and TLB infor- 
mation is returned when CPUID executes with EAX set to 2. 


INPUT EAX = 3: Serial Number Information 


Intel® Xeon Phi” coprocessor does not implement Processor Serial Number support, as 
signalled by feature bit CPUID.EAX[01h].EDX.PSN. Therefore, all the returned fields are 
considered reserved. 


INPUT EAX = 4: Returns Deterministic Cache Parameters for Each Level 


When CPUID executes with EAX set to 4 and ECX contains an index value, the processor 
returns encoded data that describe a set of deterministic cache parameters (for the cache 
level associated with the input in ECX). 
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EAX Information Provided about the Processor Return value 
Extended Function CPUID Information 
80000000H| EAX Maximum Input Value for Extended CPUID Information 80000008H 
EBX Reserved 0 
ECX — Reserved 0 
EDX _ Reserved 0 
Feature Information 
80000001H | EAX _ Reserved 0 
EBX _ Reserved 0 
ECX Bit 0: LAHF/SAHF available in 64 bit mode 1 
Bits 31-1: Reserved 0 
EDX Bits 10-0: Reserved 0 
Bit 11: SYSCALL/SYSRET available (in 64 bit mode) 1 
Bits 19-12: Reserved 0 
Bit 20: Execute Disable Bit available 0 
Bits 28-21: Reserved 0 
Bit 29: Intel® 64 Technology available 1 
Bits 31-30: Reserved 0 
Processor Brand String 
80000002H | EAX Processor Brand String 0 
EBX Processor Brand String Continued 0 
ECX Processor Brand String Continued 0 
EDX Processor Brand String Continued 0 
80000003H | EAX Processor Brand String Continued 0 
EBX Processor Brand String Continued 0 
ECX Processor Brand String Continued 0 
EDX Processor Brand String Continued 0 
80000004H | EAX Processor Brand String Continued 0 
EBX Processor Brand String Continued 0 
ECX Processor Brand String Continued 0 
EDX Processor Brand String Continued 0 
Reserved 
80000005H | EAX _ Reserved 0 
EBX Reserved 0 
ECX — Reserved 0 
EDX _ Reserved 0 


Table B.6: Information Returned by CPUID Instruction. 8000000xH leafs. 


Software can enumerate the deterministic cache parameters for each level of the cache hi- 
erarchy starting with an index value of 0, until the parameters report the value associated 
with the cache type field is 0. The architecturally defined fields reported by deterministic 
cache parameters are documented in Table B.5. The associated cache structures described 
by the different ECX descriptors are: 


e ECX=0: Instruction Cache (11) 
e ECX=1: L1 Data Cache (L1) 
e ECX=2: L2 Data Cache (L2) 
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EAX Information Provided about the Processor Return value 
80000006H | EAX Reserved 0 
EBX Reserved 0 
ECX Bits 7-0: L2 cache Line size in bytes 64 
Bits 15-12: L2 associativity field 06H 
Bits 31-16: L2 cache size in 1K units 512 
EDX Reserved 0 
Reserved 
80000007H | EAX Reserved 0 
EBX Reserved 0 
ECX Reserved 0 
EDX Reserved 0 
Virtual/Physical Address size 
80000008H | EAX _ Bits 7-0: #Physical Address Bits 40 
Bits 15-8: #Virtual Address Bits 48 
EBX Reserved 0 
ECX Reserved 0 
EDX Reserved 0 


Table B.7: Information Returned by CPUID Instruction. 8000000xH leafs. (Contd.) 


Operation 


IA32_BIOS_SIGN_ID MSR = Update with installed microcode revision number; 


case (EAX) 
{ 
EAX == 
EAX = 01H; // Highest basic function CPUID input value 
EBX = "Genu"; 
ECX = "inelI"; 
EDX = "ntel"; 
break; 
EAX = 2H: 
// Cache and TLB information 
EAX = 0; 
EBX = 0; 
ECX = 0; 
EDX = 0 
break; 
EAX = 3H: 
// PSN features 
EAX = 0; 
EBX = 0; 
0) 
0) 


2 


2 


ECX = 

EDX = 

break; 
EAX = 4H: 


2 
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// Deterministic Cache Parameters Leaf; 


EAX = *see table* 
EBX = *see tablex 
ECX = *see table* 
EDX = *see tablex 
break; 


EAX = 20000000H; 


EAX = 01H; 

EBX = 0; 

ECX = 0; 

EDX = 0; 
break; 

EAX = 20000001H; 

EAX = 0; 

EBX = 0; 

ECX = 0; 


EDX = 00000010H; 
break; 


EAX = 80000000H; 


// Extended leaf 
EAX = 08H; 

EBX = 0; 

ECX = 0; 

EDX = 0; 

break; 


EAX = 80000001H; 


EAX = 0; 
EBX = 0; 
ECX [0] 

ECX [31:1] 
EDX [10:0] 
EDX [11] 
EDX [19:12] 
EDX [20] 
EDX [28:21] 
EDX [29] 
EDX [31:30] 
break; 


i] 
OoOrPROOOrROCOF 


EAX = 80000002H; 


EAX = 0; 
EBX = 0 
ECX = 0; 
EDX = 0 
break; 


EAX = 80000003H; 


EAX = 0; 
EBX = 0; 
ECX = 0; 
EDX = 0 
break; 


2 


EAX = 80000004H; 


EAX = 0; 
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// 
// 
// 
// 


// 
// 
// 
// 


// 
// 
// 
// 


// 
// 
// 
// 
// 
// 
// 
// 
// 
// 
// 


// 
// 
// 
// 


// 
// 
// 
// 


// 


Reserved 
Reserved 
Reserved 
Reserved 


Reserved 
Reserved 
Reserved 
Reserved 


Highest extended function CPUID input value 


Reserved 
Reserved 
Reserved 


Reserved 
Reserved 


LAHF/SAHF support in 64 bit mode 


Reserved 
Reserved 


SYSCALL/SYSRET available in 64 bit mode 


Reserved 


Execute Disable Bit available 


Reserved 


Intel(R) 64 Technology 


Reserved 


Processor 
Processor 
Processor 
Processor 


Processor 
Processor 
Processor 
Processor 


Processor 


Brand 
Brand 
Brand 
Brand 


Brand 
Brand 
Brand 
Brand 


Brand 


String 
String 
String 
String 


String 
String 
String 
String 


String 


available 


Continued 
Continued 
Continued 


Continued 
Continued 
Continued 
Continued 


Continued 
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EBX = 0; // Processor Brand String Continued 
ECX = 0; // Processor Brand String Continued 
EDX = 0; // Processor Brand String Continued 
break; 
EAX = 80000005H; 
EAX = 0; // Reserved 
EBX = 0; // Reserved 
ECX = 0; // Reserved 
EDX = 0; // Reserved 
break; 
EAX = 80000006H; 
EAX = 0; // Reserved 
EBX = 0; // Reserved 
ECX[7:0] = 64; // L2 cache Line size in bytes 
ECX[15:12] = 6; // L2 associativity field (8-way) 
ECX[31:16] = 256; // L2 cache size in 1K units 
EDX = 0; // Reserved 
break; 
EAX = 80000007H; 
EAX = 0; // Reserved 
EBX = 0; // Reserved 
ECX = 0; // Reserved 
EDX = 0; // Reserved 
break; 
EAX = 80000008H; 
EAX[7:0] = 40; // Physical Address bits 
EAX[15:8] = 48; // Virtual Address bits 
EAX[31:16] = 0; // Reserved 
EBX = 0; // Reserved 
ECX = 0; // Reserved 
EDX = 0; // Reserved 
break; 
default, EAX == 1H: 
EAX[3:0] = Stepping ID; 
EAX [7:4] = *see table* // Model 
EAX[11:8] = 1011B; // Family 
EAX[13:12] = OOB; // Processor type 
EAX[15:14] = OOB; // Reserved 
EAX[19:16] = OOOOB; // Extended Model 
EAX [23:20] = OOOOOOOOB; // Extended Family 
EAX[31:24] = OOH; // Reserved; 
EBX [7:0] = OOH; // Brand Index (* Reserved if the value is zero *) 
EBX[15:8] = 8; // CLEVICT1/CLFLUSH Line Size (x8) 
EBX[23:16] = 248; // Maximum number of logical processors 
EBX [31:24] = Initial Apic ID; 
ECX = 00000000H; // Feature flags 
EDX = 110193FFH; // Feature flags 
break; 


678 Reference Number: 327364-001 


intel 
ae APPENDIX B. INTEL’ XEON PHI’ COPROCESSOR 64 BIT MODE SCALAR INSTRUCTION SUPPORT 
Flags Affected 


None. 


Intel’ C/C++ Compiler Intrinsic Equivalent 


None 


Exceptions 


None. 


Reference Number: 327364-001 679 


intel 
APPENDIX B. INTEL XEON PHI” COPROCESSOR 64 BIT MODE SCALAR INSTRUCTION SUPPORT (inte’ 


Bit | Mnemonic Description Return 
# Value 
0 FPU Floating-point Unit On-Chip. The processor contains an x87 FPU. 1 

1 VME Virtual 8086 Mode Enhancements. Virtual 8086 mode enhancements, in- | 1 


cluding CR4.VME for controlling the feature, CR4.PVI for protected mode vir- 
tual interrupts, software interrupt indirection, expansion of the TSS with the 
software indirection bitmap, and EFLAGS.VIF and EFLAGS.VIP flags. 


2 DE Debugging Extensions. Support for I/O breakpoints, including CR4.DE for | 1 
controlling the feature, and optional trapping of accesses to DR4 and DRS. 
3 PSE Page Size Extension. Large pages of size 4 MByte are supported, including | 1 


CR4.PSE for controlling the feature, the defined dirty bit in PDE (Page Directory 
Entries), optional reserved bit trapping in CR3, PDEs, and PTEs. 


4 TSC Time Stamp Counter. The RDTSC instruction is supported, including CR4.TSD | 1 
for controlling privilege. 

5 MSR Model Specific Registers RDMSR and WRMSR Instructions. The RDMSR | 1 
and WRMSR instructions are supported. Some of the MSRs are implementation 
dependent. 

6 PAE Physical Address Extension. Physical addresses greater than 32 bits are sup- | 1 


ported: extended page table entry formats, an extra level in the page transla- 
tion tables is defined, 2-MByte pages are supported instead of 4 Mbyte pages 
if PAE bit is 1. The actual number of address bits beyond 32 is not defined, and 
is implementation specific. 

7 MCE Machine Check Exception. Exception 18 is defined for Machine Checks, in- | 1 
cluding CR4.MCE for controlling the feature. This feature does not define 
the model-specific implementations of machine-check error logging, report- 
ing, and processor shutdowns. Machine Check exception handlers may have to 
depend on processor version to do model specific processing of the exception, 
or test for the presence of the Machine Check feature. 


8 CX8 CMPXCHG8B Instruction. The compare-and-exchange 8 bytes (64 bits) in- | 1 
struction is supported (implicitly locked and atomic). 
9 APIC APIC On-Chip. The processor contains an Advanced Programmable Interrupt | ? 


Controller (APIC), responding to memory mapped commands in the physical 
address range FFFEOO00H to FFFEOFFFH (by default - some processors permit 
the APIC to be relocated). 


10 | Reserved Reserved 0 

11 | SEP SYSENTER and SYSEXIT Instructions. The SYSENTER and SYSEXIT and as- | 0 
sociated MSRs are supported. 

12 | MTRR Memory Type Range Registers. MTRRs are supported. The MTRRcap MSR | 1 


contains feature bits that describe what memory types are supported, how 
many variable MTRRs are supported, and whether fixed MTRRs are supported. 
13 | PGE PTE Global Bit. The global bit in page directory entries (PDEs) and page table | 0 
entries (PTEs) is supported, indicating TLB entries that are common to differ- 
ent processes and need not be flushed. The CR4.PGE bit controls this feature. 
14 MCA Machine Check Architecture. The Machine Check Architecture, which pro- | 0 
vides a compatible mechanism for error reporting in P6 family, Pentium® 4, 
Intel® Xeon®processors, and future processors, is supported. The MCG_CAP 
MSR contains feature bits describing how many banks of error reporting MSRs 
are supported. 


Table B.8: Feature Information Returned in the EDX Register (CPUID.EAX[01h].EDX) 
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Mnemonic 


Description 


Return 
Value 


CMOV 


Conditional Move Instructions. The conditional move instruction CMOV is 
supported. In addition, if x87 FPU is present as indicated by the CPUID.FPU 
feature bit, then the FCOMI and FCMOV instructions are supported 


0 


16 


PAT 


Page Attribute Table. Page Attribute Table is supported. This feature aug- 
ments the Memory Type Range Registers (MTRRs), allowing an operating sys- 
tem to specify attributes of memory on a 4K granularity through a linear ad- 
dress. 


17 


PSE-36 


36-Bit Page Size Extension. Extended 4-MByte pages that are capable of ad- 
dressing physical memory beyond 4 GBytes are supported. This feature indi- 
cates that the upper four bits of the physical address of the 4-MByte page is 
encoded by bits 13-16 of the page directory entry. 


18 


PSN 


Processor Serial Number. The processor supports the 96-bit processor iden- 
tification number feature and the feature is enabled. 


19 


CLFSH 


CLFLUSH Instruction. CLFLUSH Instruction is supported. 


20 


Reserved 


Reserved 


i=) 


21 


DS 


Debug Store. The processor supports the ability to write debug information 
into a memory resident buffer. This feature is used by the branch trace store 
(BTS) and precise event-based sampling (PEBS) facilities (see Chapter 15, De- 
bugging and Performance Monitoring, in the IA-32 Intel® Architecture Soft- 
ware Developers Manual, Volume 3). 


22 


ACPI 


Thermal Monitor and Software Controlled Clock Facilities. The processor im- 
plements internal MSRs that allow processor temperature to be monitored 
and processor performance to be modulated in predefined duty cycles under 
software control. 


23 


Intel® MMX™ Technology. The processor supports the Intel® MMX™ technol- 
ogy. 


24 


FXSAVE and FXRSTOR Instructions. The FXSAVE and FXRSTOR instructions 
are supported for fast save and restore of the floating-point context. Presence 
of this bit also indicates that CR4.0SFXSR is available for an operating system 
to indicate that it supports the FXSAVE and FXRSTOR instructions. 


25 


Intel® SSE 


Intel® SSE. The processor supports the Intel® SSE extensions. 


26 


Intel® SSE2 


Intel® SSE2. The processor supports the Intel® SSE2 extensions. 


i=) 


27 


SS 


Self Snoop. The processor supports the management of conflicting memory 
types by performing a snoop of its own cache structure for transactions issued 
to the bus. 


28 


HTT 


Multi-Threading. The physical processor package is capable of supporting 
more than one logical processor. 


29 


T™ 


Thermal Monitor. The processor implements the thermal monitor automatic 
thermal control circuitry (TCC). 


30 


Reserved 


Reserved 


31 


PBE 


Pending Break Enable. The processor supports the use of the FERR#/PBE# 
pin when the processor is in the stop-clock state (STPCLK# is asserted) to sig- 
nal the processor that an interrupt is pending and that the processor should 
return to normal operation to handle the interrupt. Bit 10 (PBE enable) in the 
1A32_MISC_ENABLE MSR enables this capability. 


Table B.9: Feature Information Returned in the EDX Register (CPUID.EAX[01h].EDX) (Contd.) 
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Bit # Mnemonic Description Return 
Value 

0 Intel® SSE3 Streaming SIMD Extensions 3 (SSE3). A value of 1 indicates the | 0 
processor supports this technology. 

1-2 Reserved Reserved 0 

3 MONITOR MONITOR/MWAIT. A value of 1 indicates the processor sup- | 0 
ports this feature. 

4 DS-CPL CPL Qualified Debug Store. A value of 1 indicates the processor | 0 
supports the extensions to the Debug Store feature to allow for 
branch message storage qualified by CPL. 

5 VMX Virtual Machine Extensions. A value of 1 indicates that the pro- | 0 
cessor supports this technology. 

6 Reserved Reserved 0 

7 EST Enhanced Intel® SpeedStep® technology. A value of 1 indicates | 0 
that the processor supports this technology. 

8 TM2 Thermal Monitor 2. A value of 1 indicates whether the proces- | 0 
sor supports this technology. 

9 SSSE3 Supplemental Streaming SIMD Extensions 3 (SSSE3). A value | 0 
of 1 indicates the processor supports this technology. 

10 CNXT-ID L1 Context ID. A value of 1 indicates the L1 data cache mode | 0 
can be set to either adaptive mode or shared mode. A value of 
0 indicates this feature is not supported. See definition of the 
1A32_MISC_ENABLE MSR Bit 24 (L1 Data Cache Context Mode) 
for details. 

11-12 Reserved Reserved 0 

13 CMPXCHG16B CMPXCHG16B Available. A value of 1 indicates that the feature | 0 
is available. See the CMPXCHG8B/CMPXCHG16BCompare and 
Exchange Bytes section in Volume 2A. 

14 xTPR Update xTPR Update Control. A value of 1 indicates that the processor | 0 

Control supports changing IA32_MISC_ENABLES|bit 23]. 

15 PDCM Perf/Debug Capability MSR. A value of 1 indicates that the pro- | 0 
cessor supports the performance and debug feature indication 
MSR 

18-16 Reserved Reserved 0 

19 Intel® SSE4.1 Intel® Streaming SIMD Extensions 4.1 (Intel® SSE4.1). Avalue | 0 
of 1 indicates the processor supports this technology. 

20 Intel® SSE4.2 Intel® Streaming SIMD Extensions 4.2 (Intel® SSE4.2). Avalue | 0 
of 1 indicates the processor supports this technology. 

22-21 Reserved Reserved 0 

23 POPCNT POPCNT. A value of 1 indicates the processor supports the | 0° 
POPCNT instruction. 

31-24 Reserved Reserved 0 


Table B.10: Feature Information Returned in the ECX Register (CPUID.EAX[01h].ECX) 


@CPUID bit 23 erroneously indicates that POPCNT is not supported. Intel® Xeon Phi” coprocessor does support the POPCNT instruction. 


See Appendix A for more information. 
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Appendix C 


Floating-Point Exception Summary 


C.1 Instruction floating-point exception summary 


Table C.3 shows all those instruction that can generate a floating-point exception. Each type of exception is 
shown per instruction. For each table entry you will find one of the following symbols: 


Nothing : Exception of that type cannot be produced by that instruction. 


Yootn: The instruction can produce that exception. The exception may be produced by either the operation 
or the data-type conversion applied to memory operand. 


Yceonv: The instruction can produce that exception. That exception can only be produced by the data-type 
conversion applied to memory operand. 


Yoper: The instruction can produce that exception. The exception can only be produced by the operation. 
The data-type conversion applied to the memory operand cannot produce any exception. 


Instruction #1 #D #Z #0 #U #P 
vaddpd Yooth Yoper Yoper Yoper Yoper 
vaddps Yooth Yoper Yoper Yoper Yoper 
vaddnpd Yooth Yoper Yoper Yoper Yoper 
vaddnps Yooth Yoper Yoper Yoner Yoper 
vaddsetsps Yooth Yoper Yoper Yoper Yoper 
vblendmps Veony 

vbroadcastf32x4 | Ycoony 

vbroadcastss Yeon 

vemppd Yoboth Yoper 

vcempps Yooth | Yoper 

vevtpd2ps Yoboth Yoper Yooper Yoper Yoper 
vcvtps2pd Yooth | Yoper 

vevtfxpntdq2ps Yoper 
vevtfxpntpd2dq Yooth Yoper 
vevtfxpntpd2udq | Yootn Yoper 
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Instruction #] #D #Z #0 #U #P 
vevtfxpntps2dq Yooth Yoper 
vevtfxpntps2udq | Yoorn Yoper 
vevtfxpntudq2ps Yoper 
vexp223ps Yoper 

vfixupnanpd Ypoth 

vfixupnanps Yooth 

vfmadd132pd Ypoth Yoper Yoper Yoper Yoper 
vfmadd132ps Yooth Yoper Yoper Yoper Yoper 
vfmadd2 13pd Ypoth Yoper Y oper Yoper Yoper 
vfmadd2 13ps Yooth Yoper Yoper Yoper Yoper 
vfmadd23 1pd Yooth Yoper Yoper Yoper Yoper 
vfmadd23 1ps Yooth Yoper Yoper Yoper Yoper 
vfmadd233ps Yooth Yoper Yoper Yoper Yoper 
vfmsub132pd Yooth Yoper Yoper Yoper Y oper 
vfmsub132ps Yboth Yoper Yoper Yoper Yoper 
vfmsub2 13pd Yooth Yoper Yoper Yoper Yoper 
vfmsub2 13ps Yboth Yoper Yoper Yoper Yoper 
vfmsub23 1pd Yooth Yoper Yoper Yoper Yoper 
vfmsub23 1ps Yooth Yoper Yoper Yoper Yoper 
vfnmadd132pd Voorn | Yasar Yoper | Yeper | Yoper 
vfnmadd132ps Vise | Youer Yoper | Yoper | Yoper 
vfnmadd213pd Viues,.| Yonex Yoper | Yoper | Yoper 
vfnmadd213ps Yioth:. | Xaner Yoper | Yoper | Yoper 
vfnmadd231pd Yoon: | Yaner Yoper | Yoper | Yoper 
vfnmadd231ps Yootn | Yoper Yoper | Yoper | Yoper 
vfnmsub132pd Vion. | Yoner Yoper | Yoper | Yoper 
vfnmsub132ps Yiote |! Yauex Yoper | Yoper | Yoper 
vinmsub213pd Vion. | Sener Yoper | Yoper | Yoper 
vfnmsub213ps Yoon. |. Yanex Yoper | Yoper | Yoper 
vfnmsub23 1pd Yboth Yoper Yoper Yoper Yoper 
vfnmsub231ps Vion. |) Vance Yoper | Yoper | Yoper 
vgatherdps Yeonv 

vgetexppd Yooth | Yoper 

vgetexpps Yooth | Yoper 

vgetmantpd Yooth | Yoper 

vgetmantps Yooth | Yoper 

vgmaxpd Yoboth Yoper 

vemaxps Yooth | Yoper 

vgmaxabsps Yooth | Yoper 

veminpd Yooth | Yoper 

veminps Yooth | Yoper 

vloadunpackhps | Yeony 

vloadunpacklps Yicna 

vlog2ps Yooth Yoper 

vmovaps (load) Years 

vmovaps (store) | Yeony | Yeonv Yoonw | Yeonv | Yeonv 
vmulpd Yboth Yoper Yoper Yoper Yoper 
vmulps Yboth Yoper Yoper Yoper Yoper 
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Instruction #1 #D #Z #0 #U #P 
vp acksto rehps Yeony Yeonv Yeonv Yeonv Yeon 
vp acksto relps Yeonv Yeonv Yeon Yeon Yeonv 
vrcp23ps Yooth Yoper 

vrndfxpntpd Ypoth Yoper 
vrndfxpntps Yooth Yoper 
vrsqrt23ps Yooth Yoper 

vscaleps Yooper Yoper Y oper Y oper Y oper 
vscatterdps Yeon Yeon Yeonu Yeon Yeonu 
vsubpd Yooth Yooper Yoper Yoper Yoper 
vsubps Yboth Yoper Yoper Yoper Yoper 
vsubrpd Yboth Yoper Yoper Yoper Yoper 
vsubrps Yboth Yoper Yoper Yoper Yoper 


C.2 Conversion floating-point exception summary 


Float-to-float 

Float16 to float32 SwizzUpConv/UpConv | Invalid (on SNaN) 

Float32 to float64 VCVTPS2PD Invalid (on SNaN), Denormal 

Float32 to float16 DownConv Invalid (on SNaN), Overflow, Underflow, 
Precision, Denormal 

Float64 to float32 VCVTPD2PS Invalid (on SNaN), Overflow, Underflow, 
Precision, Denormal 

Integer-to-float 

Uint8/16 to float32 UpConv None 

Sint8/16 to float32 UpConv None 

Uint32 to float32 VCVTFXPNTUDQ2PS_ | Precision 

Sint32 to float32 VCVTFXPNTDQ2PS Precision 

Uint32 to float64 VCVTUDQ2PD None 

Sint32 to float64 VCVTDQ2PD None 

Float-to-integer 

Float32 to uint8/16 DownConv Invalid (on NaN, out-of-range), Precision 
(if in-range but input not integer) 

Float32 to sint8/16 DownConv Invalid (on NaN, out-of-range), Precision 
(if in-range but input not integer) 

Float32 to uint32 VCVTFXPNTPS2UDQ_| Invalid (on NaN, out-of-range), Precision 
(if in-range but input not integer) 

Float32 to sint32 VCVTFXPNTPS2DQ Invalid (on NaN, out-of-range), Precision 
(if in-range but input not integer) 

Float64 to uint32 VCVTFXPNTPD2UDQ _ | Invalid (on NaN, out-of-range), Precision 
(if in-range but input not integer) 

Float64 to sint32 VCVTFXPNTPD2DQ Invalid (on NaN, out-of-range), Precision 
(if in-range but input not integer) 
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Out-of-range values are dependent on operation definition and rounding mode. Table C.3 and Table C.4 describe 
maximum and minimum allowed values for float to integer and float to float conversion respectively. Please note 
that presented ranges are considered after “Denormals Are Zero (DAZ)" are applied. 


Those entries in Table C.4 labelled with an asterisk(*), are not required for the Intel® Xeon Phi” coprocessor. 


C.3. Denormal behavior 
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Instruction Treat Input Denormals As Zeros | Flush Tiny Results To Zero 
vaddpd MXCSR.DAZ MXCSR.FZ 
vaddps MXCSR.DAZ MXCSR.FZ 
vaddnpd MXCSR.DAZ MXCSR.FZ 
vaddnps MXCSR.DAZ MXCSR.FZ 
vaddsetsps MXCSR.DAZ MXCSR.FZ 
vblendmpd NO NO 

vblendmps NO NO 

vemppd MXCSR.DAZ Not Applicable 
vcempps MXCSR.DAZ Not Applicable 
vcevtdq2pd Not Applicable Not Applicable 
vevtpd2ps MXCSR.DAZ MXCSR.FZ 
vcvtps2pd MXCSR.DAZ Not Applicable 
vcvtudq2pd Not Applicable Not Applicable 
vevtfxpntdq2ps Not Applicable Not Applicable 
vevtfxpntpd2dq MXCSR.DAZ Not Applicable 
vevtfxpntpd2udq MXCSR.DAZ Not Applicable 
vevtfxpntps2dq MXCSR.DAZ Not Applicable 
vevtfxpntps2udq MXCSR.DAZ Not Applicable 
vevtfxpntudq2ps Not Applicable Not Applicable 
vexp223ps Not Applicable YES 
vfixupnanpd MXCSR.DAZ NO 
vfixupnanps MXCSR.DAZ NO 
vfmadd132pd MXCSR.DAZ MXCSR.FZ 
vfmadd132ps MXCSR.DAZ MXCSR.FZ 
vfmadd213pd MXCSR.DAZ MXCSR.FZ 
vfmadd213ps MXCSR.DAZ MXCSR.FZ 
vfmadd231pd MXCSR.DAZ MXCSR.FZ 
vfmadd231ps MXCSR.DAZ MXCSR.FZ 
vfmadd233ps MXCSR.DAZ MXCSR.FZ 
vfmsub132pd MXCSR.DAZ MXCSR.FZ 
vfmsub132ps MXCSR.DAZ MXCSR.FZ 
vfmsub213pd MXCSR.DAZ MXCSR.FZ 
vfmsub213ps MXCSR.DAZ MXCSR.FZ 
vfmsub231pd MXCSR.DAZ MXCSR.FZ 
vfmsub231ps MXCSR.DAZ MXCSR.FZ 
vfnmadd132pd MXCSR.DAZ MXCSR.FZ 
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Instruction Treat Input Denormals As Zeros | Flush Tiny Results To Zero 
vfnmadd132ps MXCSR.DAZ MXCSR.FZ 
vfnmadd213pd MXCSR.DAZ MXCSR.FZ 
vfnmadd213ps MXCSR.DAZ MXCSR.FZ 
vfnmadd231pd MXCSR.DAZ MXCSR.FZ 
vfnmadd231ps MXCSR.DAZ MXCSR.FZ 
vfnmsub132pd MXCSR.DAZ MXCSR.FZ 
vfnmsub132ps MXCSR.DAZ MXCSR.FZ 
vfnmsub213pd MXCSR.DAZ MXCSR.FZ 
vfnmsub213ps MXCSR.DAZ MXCSR.FZ 
vfnmsub231pd MXCSR.DAZ MXCSR.FZ 
vfnmsub231ps MXCSR.DAZ MXCSR.FZ 
vgatherdpd NO NO 
vgatherdps NO NO 
vgatherpf0dps NO NO 
vgatherpfOhintdpd NO NO 
vgatherpfOhintdps NO NO 
vgatherpfidps NO NO 
vgetexppd MXCSR.DAZ Not Applicable 
vgetexpps MXCSR.DAZ Not Applicable 
vgetmantpd MXCSR.DAZ Not Applicable 
vgetmantps MXCSR.DAZ Not Applicable 
vgmaxpd MXCSR.DAZ NO 
vgmaxps MXCSR.DAZ NO 
vgmaxabsps MXCSR.DAZ NO 
vgminpd MXCSR.DAZ NO 
vgminps MXCSR.DAZ NO 
vloadunpackhpd NO NO 
vloadunpackhps NO NO 
vloadunpacklpd NO NO 
vloadunpacklps NO NO 
vlog2ps YES YES 
vmovapd (load) NO NO 
vmovapd (store) NO (DAZ*) NO 
vmovaps (load) NO NO 
vmovaps (store) NO (DAZ*) NO 
vmovnrapd (load) NO NO 
vmovnrapd (store) NO (DAZ*) NO 
vmovnraps (load) NO NO 
vmovnraps (store) NO (DAZ*) NO 
vmovnrngoapd (load) | NO NO 
vmovnrngoapd (store) | NO (DAZ*) NO 
vmovnrngoaps (load) NO NO 
vmovnrngoaps (store) | NO (DAZ*) NO 
vmulpd MXCSR.DAZ MXCSR.FZ 
vmulps MXCSR.DAZ MXCSR.FZ 
vpackstorehpd NO (DAZ*) NO 
vpackstorehps NO (DAZ*) NO 
vpackstorelpd NO (DAZ*) NO 
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Instruction Treat Input Denormals As Zeros | Flush Tiny Results To Zero 
vpackstorelps NO (DAZ*) NO 
vrcp23ps YES YES 
vrndfxpntpd MXCSR.DAZ NO 
vrndfxpntps MXCSR.DAZ NO 
vrsqrt23ps YES YES 
vscaleps MXCSR.DAZ MXCSR.FZ 
vscatterdpd NO (DAZ*) NO 
vscatterdps NO (DAZ*) NO 
vscatterpf0dps NO NO 
vscatterpfOhintdpd NO NO 
vscatterpfOhintdps NO NO 
vscatterpfidps NO NO 
vsubpd MXCSR.DAZ MXCSR.FZ 
vsubps MXCSR.DAZ MXCSR.FZ 
vsubrpd MXCSR.DAZ MXCSR.FZ 
vsubrps MXCSR.DAZ MXCSR.FZ 


(*) FP32 down-conversion obeys MXCSR.DAZ 
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(dint + O'T - LE_Z-) JHIJTO0000002T9X0 (dint - LEZ) JSIIIIIHIIIP TL HXO ZU OdZddLNdXALADA | ZEIS 01 79ICOTA 
(dint + O'T - LE_-Z-) JHIJTO0000002T9X0 (O'T - TE-Z) D00002IIHIIPTPXO ext OdZAdLNdXALADA | ZEUIS 01 79IeOTJ 
(TE_-Z-) 00000000000002T9x0 (dint - LEZ) JSIIIIIIIIIP TL HXO au OdZddLNdXALADA | ZEIIS 01 79ICOTA 
(S'0 - LE_-Z-) 00000T00000002T2x0 (dint - S°0 - LELZ) JJIIPIIIIPTLXO NU OdZddLNdXALADA | ZEIUIS 03 79ICOTA 
(dint + O'T-) IIWIIIUITEIIXO (dint - ZE-Z) HHIIIHIJOTLXO ZU OGNZdd.LNdXALADA | ZEWUM 0} 79IOT A 
(dint + O'L-) IWIIIHITIEIAIXO (O'L - ZE-Z) 00000°IFHETPXO ext OdNZdd.LNdXALADA | ZEUM 0} 79IOT A 
(0°0-) 0000000000000008x0 (dint - ZE_-Z) HIIPYIIJOTLXO au OGNZdd.LNdXALADA | ZEWIN 0} 7OIOTA 
(S"0-) 0000000000000939x0 (dint - $°0 - ZE_Z) JGJIJOIIH2THXO NU OAGNZdd.LNdXALADA | ZEN 0} 79IOTJ 
(TE_-Z-) 00000052x0 (dint - LEZ) IIHEPX0 ZU OAZSdLNdXALADA | ZEWIS 01 ZEICOTA 
(TE_-Z-) 00000052x0 (dint - LE_Z) JIHePX0 rats OAZSdLNdXALADA | ZEIUIS 01 ZEIOTA 
(TE_-Z-) 00000052x0 (dint - LEZ) JIHEPX0 au OAZSdLNdXALADA | ZEWIS 01 ZEICOTA 
(TE_-Z-) 00000052x0 (dint - LEZ) JHEPX0 NU OAZSdLNdXALADA | ZEUS 01 ZEICOTA 

(dint + O'T-) JIWIZIIXO (dint - Z€-Z) JULIVXO Zu OANZSdLNdUXALADA | ZEWIN 07 ZEI COTA 

(dint + O'T-) JIWIZIIXO (dint - Z€-Z) IBILIPXO ext OANZSdLNAUXALADA | ZEIIN 0} ZEIeOTA 

(0°0-) 00000008x0 (dint - Z€_Z) JNHLIVXO au OANZSALNdXALADA | ZEIIN 07 ZEI COTA 

(s'0-) 00000059x0 (dint - Z€_Z) JNHLIVXO NU OGNZSALNdXALADA | ZEIIN 07 ZE1 CO] 
(S°89ZZE-) 08000029X0 (dint - S°Z9LZE) JJPIIOLXO NU AuojUMOg QTqWIS 0} ZEICOTA 
(s'0-) 00000059x0 (dint - S°G€SS9) JLWIZLPXO NU AuojUMOGg gTquIM 03 Z¢E1eO] 4 

(S'8ZT-) 000800€2x0 (dint - $°ZZT) JHIYTHXO NU AuojUMOg QqUIS 0} ZEIOT A 

(s'0-) 00000059x0 (dint - ¢°SSZ) JIZILEPXO NU AuojUMOg gquIn 07 Z7¢E3eO] 

Ul] xXey sulpunoy 37X9]U0*) UOISI9OAUO*) 


ntel 
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Case Rounding Max pos arg w/o overflow Min pos arg w/ overflow 
Float32 to float16 RN 0x477fefff (65520.0 - Lulp) 0x477ff000 (65520.0) 

RD* 0x477fffff (65536.0 - Lulp) 0x47800000 (65536.0) 

RU* 0x477fe000 (65504.0) 0x477fe001 (65504.0 + 1ulp) 

RZ 0x477fffff (65536.0 - Lulp) 0x47800000 (65536.0) 
Float64 to float32 RN 0x47 efffffeffffttf (2125 — 215 — lulp) 0x47 effffff0000000 (2178 — 2193) 

RD 0x47 ef ffffffffffff (212° — 1ulp) 0x4-7f0000000000000 (2!28-°) 

RU 0x47 efffffe0000000 (2125 — 214) 0x47efffffe0000001 (2128 — 2194 + 1ulp) 

RZ 0x47 ef fffftfffffff (21° — 1ulp) 0x4-7f0000000000000 (2!28-°) 
Case Rounding Max neg arg w/o overflow Min neg arg w/ overflow 
Float32 to float16 RN Oxc77fefff (-65520.0 + 1ulp) Oxc77ff000 (-65520.0) 

RD* Oxc77fe000 (-65504.0) Oxc77fe001 (-65504.0 - 1ulp) 

RU* Oxc77 fffff (-65536.0 + 1ulp) 0xc7800000 (-65536.0) 

RZ Oxc77 fffff (-65536.0 + 1ulp) 0xc7800000 (-65536.0) 
Float64 to float32 RN Oxc7efffffefffffff (—2'7° + 21° + 1ulp) Oxc7 effffff0000000 (—2!78 + 21°) 

RD Oxc7efffffe0000000 (—2!78 + 2194) | Oxc7efffffe0000001 (—2!?8 + 21°4 — 1ulp) 

RU Oxc7 ef ffffffffffff (—2'?5 + 1ulp) 0xc7f0000000000000 (—2!28-°) 

RZ Oxc7 ef ffffffffffff (—2'?5 + 1ulp) 0xc7£0000000000000 (—2!2°-°) 


Table C.4: Float-to-float Max/Min Valid Range 
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Appendix D 


Instruction Attributes and Categories 


In this Appendix we enumerate instruction attributes and categories 
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D.1 Conversion Instruction Families 


D.1.1  Dyso Family of Instructions 


VMOVAPS VMOVNRAPS VMOVNRNGOAPS  VPACKSTOREHPS 
VPACKSTORELPS VSCATTERDPS VSCATTERPF1DPS 


D.1.2 Dye, Family of Instructions 
VMOVAPD VMOVNRAPD VMOVNRNGOAPD VPACKSTOREHPD 


VPACKSTORELPD VSCATTERDPD 


D.1.3. Dj32 Family of Instructions 


VMOVDQA32 VPACKSTOREHD VPACKSTORELD VPSCATTERDD 


D.1.4 Die, Family of Instructions 


VMOVDQA64 VPACKSTOREHQ VPACKSTORELQ VPSCATTERDQ 


D.1.5 S39 Family of Instructions 


VADDNPS VADDPS VADDSETSPS VBLENDMPS 
VCMPPS VCVTFXPNTPS2DQ VCVTFXPNTPS2UDQ VCVTPS2PD 
VFMADD132PS VFMADD213PS VFMADD231PS VFMADD233PS 
VFMSUB132PS VFMSUB213PS VFMSUB231PS VFNMADD132PS 
VFNMADD213PS VFNMADD231PS VFNMSUB132PS VFNMSUB213PS 
VFNMSUB231PS VGETEXPPS VGETMANTPS VGMAXABSPS 
VGMAXPS VGMINPS VMULPS VRNDFXPNTPS 
VSUBPS VSUBRPS 


D.1.6 Sy, Family of Instructions 


VADDNPD VADDPD VBLENDMPD VCMPPD 
VCVTFXPNTPD2DQ VCVTFXPNTPD2UDQ VCVTPD2PS VFMADD132PD 
VFMADD213PD VFMADD231PD VFMSUB132PD VFMSUB213PD 
VFMSUB231PD VFNMADD132PD VFNMADD213PD VFNMADD231PD 
VFNMSUB132PD VFNMSUB213PD VFNMSUB231PD VGETEXPPD 
VGETMANTPD VGMAXPD VGMINPD VMULPD 
VRNDFXPNTPD VSUBPD VSUBRPD 
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D.1.7  Sj32 Family of Instructions 


VCVTDQ2PD VCVTFXPNTDQ2PS VCVTFXPNTUDQ2PS VCVTUDQ2PD 


VFIXUPNANPS VPADCD VPADDD VPADDSETCD 
VPADDSETSD VPANDD VPANDND VPBLENDMD 
VPCMPD VPCMPEQD VPCMPGTD VPCMPLTD 
VPCMPUD VPMADD231D VPMADD233D VPMAXSD 
VPMAXUD VPMINSD VPMINUD VPMULHD 
VPMULHUD VPMULLD VPORD VPSBBD 
VPSBBRD VPSLLD VPSLLVD VPSRAD 
VPSRAVD VPSRLD VPSRLVD VPSUBD 
VPSUBRD VPSUBRSETBD VPSUBSETBD VPTESTMD 
VPXORD VSCALEPS 


D.1.8 Sj¢4 Family of Instructions 


VFIXUPNANPD VPANDNQ VPANDQ VPBLENDMQ 
VPORQ VPXORQ 


D.1.9 Uys Family of Instructions 


VBROADCASTF32X4 VBROADCASTSS VGATHERDPS VGATHERPFODPS 
VGATHERPFOHINTDPS VGATHERPF1DPS VLOADUNPACKHPS VLOADUNPACKLPS 
VMOVAPS VMOVNRAPS VMOVNRNGOAPS VSCATTERPFODPS 


VSCATTERPFOHINTDPS 


D.1.10 Uy, Family of Instructions 


VBROADCASTF64X4_ VBROADCASTSD VGATHERDPD VGATHERPFOHINTDPD 
VLOADUNPACKHPD VLOADUNPACKLPD VMOVAPD VMOVNRAPD 
VMOVNRNGOAPD VSCATTERPFOHINTDPD 


D.1.11 Uj32 Family of Instructions 


VBROADCASTI32X4 VLOADUNPACKHD VLOADUNPACKLD VMOVDQA32 
VPBROADCASTD VPGATHERDD 


D.1.12 Uj, Family of Instructions 


VBROADCASTI64X4 VLOADUNPACKHQ VLOADUNPACKLQ VMOVDQA64 
VPBROADCASTQ VPGATHERDQ 
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Appendix E 


Non-faulting Undefined Opcodes 


The following opcodes are non-faulting and have undefined behavior: 


694 


MVEX.512.0F38.W0 D2 /r 
MVEX.512.0F38.W0 D3 /r 
MVEX.512.0F38.W0 D6 /r 
MVEX.512.0F38.W0 D7 /r 
MVEX.512.66.0F38.W0 48 /r 
MVEX.512.66.0F38.W0 49 /r 
MVEX.512.66.0F38.W0 4A /r 
MVEX.512.66.0F38.W0 4B /r 
MVEX.512.66.0F38.W0 68 /r 
MVEX.512.66.0F38.W0 69 /r 
MVEX.512.66.0F38.W0 6A /r 
MVEX.512.66.0F38.W0 6B /r 
MVEX.512.66.0F38.W0 BO /r /vsib 
MVEX.512.66.0F38.W0 B2 /r /vsib 
MVEX.512.66.0F38.W0 CO /r /vsib 
MVEX.512.66.0F38.W0 D2 /r 
MVEX.512.66.0F38.W0 D6 /r 
MVEX.512.66.0F3A.W0 DO /r ib 
MVEX.512.66.0F3A.W0 D1 /r ib 
MVEX.NDS.512.66.0F38.W0 54 /r 
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MVEX.NDS.512.66.0F38.W0 56 /r 
MVEX.NDS.512.66.0F38.W0 57 /r 
MVEX.NDS.512.66.0F38.W0 67 /r 
MVEX.NDS.512.66.0F38.W0 70 /r 
MVEX.NDS.512.66.0F38.W0 71 /r 
MVEX.NDS.512.66.0F38.W0 72 /r 
MVEX.NDS.512.66.0F38.W0 73 /r 
MVEX.NDS.512.66.0F38.W0 94 /r 
MVEX.NDS.512.66.0F38.W0 CE /r 
MVEX.NDS.512.66.0F38.W0 CF /r 
MVEX.NDS.512.66.0F38.W1 94 /r 


MVEX.NDS.512.66.0F38.W1 CE /r 
VEX.128.F2.0F38.W0 FO /r 
VEX.128.F2.0F38.W0 F1 /r 
VEX.128.F2.0F38.W1 FO /r 
VEX.128.F2.0F38.W1 F1 /r 
VEX.128.F3.0F38.W0 FO /r 
VEX.128.F3.0F38.W1 FO /r 
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Appendix F 


General Templates 


In this Chapter all the general templates are described. Each instruction has one (at least) valid format, and each 
format matches with one of these templates. 
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APPENDIX F. GENERAL TEMPLATES 
Mask m0 - Template 


VMASKMask m0 
Opcode Instruction Description 
VEX.128 KOP k1, k2 Operate [mask k1 and] mask k2 [and store the 
result in k1] 
Description 


Operand is a register 


ESCAPE(C5)/1 1 0 0/0 1 0 1 
7 6 5 4 3 2 IU 
VEX2 1/1 1 1 1/0} nm po 
7 6 5 43-2 TU 
OPCODE OPCODE 
a a 
ModR/M 11 reg (K1) r (K2) 
7 6 5 4 3 2 TI 0 
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Mask m1 - Template 


VMASKMask m1 

Opcode Instruction Description 

VEX.128 KOP r32/r64, k1, imm8 Move mask k1 into r32/r64 using imm8 
Description 


Operand is a register 


ESCAPE(C4) 1 1 O 0 0 1 0 0 

7 65 a 3 2 0 
VEX1 Iregg 1 1 |ms mg mg my mo 

7 S35 z 3 z 0 
VEX2 W 1 1 1 1 | L=0 | py po 

7 65 a 3 2 0 
OPCODE OPCODE 

if 6 5 a 3 2 0 
ModR/M 11 reg (reg) r (K1) 

5 z 3 z U 

{IM M8} Tz Ig Is Ig Tg Tz I, Io 

7 65 a 3 2 0 
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VMASKMask m2 
Opcode Instruction Description 
Description 
Operand is a register 
ESCAPE(C4) 1 1 0 0 0 1 0 
7 6 5 7 3 z T U 
VEX1 Iregz 1 1 ma ms mz Mm, mo 
7 6 5 q 3 2 T 0 
VEX2 W 1 Kl» "Ky 'K1o L=0 Pi Po 
7 6 5 q 3 z T 0 
OPCODE OPCODE 
c 6 5 m1 3 z T U 
ModR/M 11 reg (reg) r (K2) 
7 6 q 3 2 T 0 
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Mask m3 - Template 


VMASKMask m3 

Opcode Instruction Description 

VEX.128 KOP r32/r64, k1 Move mask k1 into r32/r64 
Description 


Operand is a register 


ESCAPE(C5) 1 10 0;0 1 0 1 
7 6 5 4-32 U 
VEX1 lregg | 1 1 1 1/0] pp, po 
ig a a U 
OPCODE OPCODE 
7 6 5 4 32 0 
ModR/M 11 reg (reg) r (K1) 
7 Sb 5 4 3 2 0 
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Mask m4 - Template 


VMASKMask m4 

Opcode Instruction Description 

VEX.128 KOP k1, r32/r64 Move r32/r64 into mask k1 
Description 


Operand is a register 


C4 Version 
ESCAPE(C4) | 1 1 0 0 0 1 0 0 
76 5 a 3 Z 0 
VEX1 1 1 !regy | my m3 mg my, mo 
76 a 3 z 0 
VEX2 Wwi}i1 1 1 1 0 | pi po 
76 5 7 3 z 0 
OPCODE OPCODE 
76 5 a 3 Z U 
ModR/M 11 reg (K1) r (reg) 
76 5 a 3 2 U 
C5 Version 
ESCAPE(C5) | 1 1 0 0 0 1 0 1 
76 5 a 3 Z U 
VEX1 1 1 1 1 1 0 | pi po 
76 5 a 3 z 0 
OPCODE OPCODE 
76 5 a 3 Z U 
ModR/M 11 reg (K1) r (reg) 
76 5 a 3 z 0 
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Mask m5 - Template 


VMASKMask m5 

Opcode Instruction Description 

VEX.128 KOP k1, r32/r64, imm8 Move r32/r64 field into mask k1 using imm8 
Description 


Operand is a register 


ESCAPE(C4) | 1 1 0 0 0 1 0 
76 5 a 3 z T 0 
VEX1 1 1 treggy | m4 m3 mg my mo 
76 5 z 3 Z T U 
VEX2 wii 1 1 1 | L=0 |} py po 
7 6 5 a 3 z T 0 
OPCODE OPCODE 
7 6 5 4 3 2 I 0 
ModR/M 11 reg (K1) r (reg) 
76 5 z 3 Z T U 
{IM M8} Iz I¢ Ts I, I 1D I, Ip 
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Vector vO - Template 


VectorVector vO 
Opcode Instruction Description 
MVEX.512 VOP zmml1 _ {ki}, zmm2, Operate vector zmm2 and vector S(zmm3/m:) 
S(zmm3/mz) [and vector zmm1] and store the result in 
zmm1, under write-mask k1 
MVEX.512 VOP zmm1 _ {ki}, zmmz2, Operate vector zmm2 and vector S(zmm3/mz;) 
S(zmm3/m+), imm8s [and vector zmm1] and store the result in 
zmm1 using imm8, under write-mask k1 
Description 


Operand is a register 


ESCAPE(62) 
MVEX1 
MVEX2 
MVEX3 
OPCODE 
ModR/M 


{IM M8} 


Operand is a memory location 


ESCAPE(62) 
MVEX1 
MVEX2 
MVEX3 
OPCODE 
ModR/M 
{SIB} 


{DISPL} 
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0 1 1 0 0 0 1 0 
7 6 D 4 3 2 0) 
IZ 13 1734 1733 IZ14 m3 m2 my mo 
7 6 5 4 3 2 0 
WwW 1Z23 IZ 2 1Z2y IZ 20 L=0 Pi Po 
7 6 5 4 3 2 0 
EH So Sy So 1Z24 Kilo Ky Ko 
7 6 D a 3 2 0) 
OPCODE 
7 6 5 4 3 2 0 
11 reg (ZMM1) r (ZMM3) 

7 D a 3 2 0) 
Ty iy is v8 is I ii TG 
7 6 5 4 3 2 0 
0 1 1 0 0 0 1 0 
7 6 D 4 3 Z 0) 
IZ13 1X IB IZ14 m3, mga My mo 
7 6 5 4 3 2 0 
W IZ 23 IZ 29 172) IZ 20 L=0 Pi Po 
7 6 5 4 3 2 0 
EH | So Sy Sy | ae | Klis Aly ly 
7 6 D 4 3 2 0) 
OPCODE 
7 6 5 4 3 2 0 

mod reg (ZMM1) m (mt) 
7 6 D a 3 2 0) 
SIB byte 
id 6 5 4 3 2 0 
Displacement (8*N/32) 
31,8 : : . . 0 
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{IMM8} | Ir I i. Bh fb hh ty | 
7 
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Vector v1 - Template 


VectorVector v1 
Opcode Instruction Description 
MVEX.512 VOP zmm1 {k1}, S(mz) Load/brodcast vector S(m,) into zmm1, under 
write-mask k1 
Description 


Operand is a memory location 


ESCAPE(62) 0 ot 0 0 1 0 

7 6 5 4 3 z T U 
MVEX1 IZ13 1X IB IZ 14 M3 mg M1 mo 

7 6 5 q 3 z T y 
MVEX2 W 1 1 1 1 | L=0 | py Po 

7 6 5 a 3 z T U 
MVEX3 EH | Sp Si So 1 | Klg Kl, Kilo 

7 6 5 4 3 z T U 
OPCODE OPCODE 

7 6 5 q 3 z T 1 
ModR/M mod reg (ZMM1) m (mt) 

7 6 5 a 3 z T U 
{SIB} SIB byte 

7 6 5 4 3 z T y 
{DISPL} Displacement (8*N/32) 
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VectorVector v10 
Opcode Instruction Description 
MVEX.512 VOP zmm1 {k1}, S(zmm2/m:) Operate vector S(zmm2/m,) and store the re- 
sult in zmm1, under write-mask k1 
MVEX.512 VOP zmm1 {k1}, S(zmm2/m,), Operate vector S(zmm2/m,) and store the re- 
imm8s sult in zmm1 using imm8, under write-mask k1 
MVEX.512 VOP zmm1 {k1}, S(zmm2/m:) Move vector S(zmm2/m;) into zmm1, under 
write-mask k1 
Description 


Operand is a register 


ESCAPE(62) | 0 1 1 0 0 0 1 0 
7 6 5 a 3 z U 
MVEX1 1 1224 !723 1 ms me my mo 
7 6 5 4 3 2 U 
MVEX2 W /!Z13) !Z12 !Z1, !Z159 | L=0 |] pi Po 
7 6 5 q 3 z y 
MVEX3 EH So Sy So | !Z14 | Klg K1y Ko 
7 6 5 a 3 Z U 
OPCODE OPCODE 
7 6 5 4 3 2 y 
ModR/M 11 Op. Ext. r (ZMM2) 
q z U 
{IM M8} Ly Ig Ts I T3 I I, Io 
7 6 5 4 3 2 U 
Operand is a memory location 
ESCAPE(62) | 0 1 1 0 0 0 at 0 
7 6 5 z 3 z U 
MVEX1 1 1X 'B 1 ms me m1  ™o 
7 6 5 4 3 2 U 
MVEX2 WwW IZ 13 IZ1o IZ 1, IZ1o L=0 P1 Po 
7 6 5 q 3 z y 
MVEX3 EH So Sy So | !Z14 | Klp K1, Ko 
7 6 5 a 3 z U 
OPCODE OPCODE 
7 6 5 a 3 2 0 
ModR/M mod Op. Ext. m (mt) 
7 6 5 a 3 z U 
{SIB} SIB byte 
7 6 5 4 3 2 U 
{DISPL} Displacement (8*N/32) 
31,8 y 
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VectorVector v11 
Opcode Instruction Description 
MVEX.512 VOP zmm1 {k1}, zmm2, S(mz) Load/brodcast and OP vector S(m:) with 
zmm_2 and write result into zmm1, under write- 
mask k1 
Description 


Operand is a memory location 


ESCAPE(62) 0 1 1 0 0 0 1 0 

7 6 5 4 3 z U 
MVEX1 IZ 13 1X IB IZ14 m3, mga My mo 

7 6 5 q 3 z U 
MVEX2 W | !Z23  !Z2. '!Z2, 1229 | L=0 | py Po 

7 6 5 4 3 z 1 
MVEX3 EH So Sy So | !Z24 | Klg Kl, Ko 

7 6 5 q 3 z y 
OPCODE OPCODE 

7 6 5 a 3 Z U 
ModR/M mod reg (ZMM1) m (mt) 

7 6 5 4 3 z U 
{SIB} SIB byte 

7 6 5 q 3 z y 
{DISPL} Displacement (8*N/32) 

31,8 ; , : ; U 
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VectorVector v2 
Opcode Instruction Description 
MVEX.512 VOP k2 {k1},zmm2, S(zmm3/m,) Operate vector zmm2 and vector S(zmm3/mz) 
and store the result in k2, under write-mask k1 
MVEX.512 VOP k2 {k1},zmm2, S(zmm3/m,), Operate vector zmm2 and vector S(zmm3/m,) 
imm8s and store the result in k2 using imm8, under 
write-mask k1 
Description 


Operand is a register 


ESCAPE(62) | 0 1 1 0 0 0 ul 0 

7 6 5 2 3 z U 
MVEX1 1 1Z24 1725 1 m3 mg, my mo 

7 6 5 4 3 z U 
MVEX2 W | !Z13 !Z12 !Z71, !Z1o | L=0 | pi Po 

7 6 5 q 3 z 0 
MVEX3 EH So Si So | !Z14 | Klg K1ly Ko 

7 6 5 a 3 z U 
OPCODE OPCODE 

7 6 5 a 3 2 0 
ModR/M 11 reg (K2) r (ZMM2) 

7 7 3 
{IM M8} Iz I Ts I T3 Ig I, Io 

7 6 5 a 3 Z U 
Operand is a memory location 
ESCAPE(62) | 0 1 1 0 0 0 1 0 

7 6 5 q 3 z 1 
MVEX1 1 1X 'B 1 ms mez my mo 

7 6 5 4 3 z U 
MVEX2 WwW IZ13 IZ1o 714 IZ1o L=0 Pi Po 

7 6 5 q 3 z y 
MVEX3 EH So Sy So | !Z14 | Klg Kl, Ko 

7 6 5 a 3 z U 
OPCODE OPCODE 

7 6 5 4 3 z 0 
ModR/M mod reg (K2) m (mt) 

7 6 q z iy 
{STB} SIB byte 

7 6 5 a 3 z 0 
{DISPL} Displacement (8*N/32) 

31,8 4 ‘ . : . 0 

{IM M8} Iz I6 Ts I T3 Ig I, Io 
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VectorVector v3 
Opcode Instruction Description 
MVEX.512 VOP m: {k1}, D(zmm1) Store vector D(zmm1) into m;:, under write- 
mask k1 
Description 
Operand is a memory location 
ESCAPE(62) 0 1 1 0 0 1 0 
7 6 5 4 3 z T U 
MVEX1 IZ13 1X IB IZ 14 M3 mg M1 mo 
7 6 5 q 3 z T y 
MVEX2 W 1 1 1 1 | L=-0 |] pi Po 
7 6 5 a 3 z T U 
MVEX3 EH | Sp Si So 1 | Klg Kl, Kilo 
if 6 5 4 3 z T U 
OPCODE OPCODE 
7 6 5 q 3 z T 1 
ModR/M mod reg (ZMM1) m (mt) 
7 6 5 a 3 z T U 
{SIB} SIB byte 
7 6 5 4 3 z T y 
{DISPL} Displacement (8*N/32) 
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VectorVector v4 
Opcode Instruction Description 
MVEX.512 VOP zmm1 {k1}, zmm2/m; Operate vector zmm2/m, and store the result 
in zmm1, under write-mask k1 
MVEX.512 VOP zmm1 {k1},zmm2/m;,imm8 Operate vector zmm2/m, and store the result 
in zmm1 using imm8, under write-mask k1 
Description 


Operand is a register 


ESCAPE(62) 
MVEX1 
MVEX2 
MVEX3 
OPCODE 
ModR/M 


{IM M8} 


Operand is amemory location 


ESCAPE(62) 
MVEX1 
MVEX2 
MVEX3 
OPCODE 
ModR/M 
{SIB} 
{DISPL} 


{IM M8} 


0 1 1 0 0 0 1 0 
7 6 5 Z 3 Z T U 
IZ 1s IZ 24 1725 Z14 m3 ms, M41, mo 
7 6 5 q 3 z T 0 
W 1 1 1 1 | L=0 |) py Po 
7 6 5 Zq 3 z T 0 
EH 0 0 0 1 | Klg Kl, Klo 
7 6 5 z 3 z T U 
OPCODE 
7 6 5 a 3 2 T 0 
11 reg (ZMM1) r (ZMM2) 

6 5 q 3 z T 0 

Ty I¢ Ts I4 Tz D qi, Ip 

i 6 5 z 3 Z T D 

0 1 1 0 0 0 1 0 

7 6 5 q 3 z T 0 
IZ 15 1X IB IZ14 m3 mg, My mo 

7 6 5 a 3 2 I 0 

W 1 1 1 1 L=0 Pi Po 

7 6 5 q 3 2 T 0 
EH 0 0 0 1 | Klp Kl, Klo 

7 6 5 Z 3 Z T U 

OPCODE 
7 6 5 q 3 z T 0 
mod reg (ZMM1) m (mt) 
7 6 5 q 3 z T 0 
SIB byte 
7 6 5 q 3 z T U 
Displacement (8*N/32) 

31,8 : : ; . U 

Ty I¢ Ts I4 Tz 1D qi, Ip 

‘4 6 5 q 3 z T 0 
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VectorVector v5 
Opcode Instruction Description 
MVEX.512 VOP zmm1 {k1}, S(zmm2/mz:) Operate vector S(zmm2/m,) and store the re- 
sult in zmm1, under write-mask k1 
MVEX.512 VOP zmm1 {k1}, S(zmm2/m,), Operate vector S(zmm2/m,) and store the re- 
imm8 sult in zmm1 using imm8, under write-mask k1 
MVEX.512 VOP zmm1 {k1}, S(zmm2/m:) Move vector S(zmm2/m;) into zmm1, under 
write-mask k1 
Description 


Operand is a register 


ESCAPE(62) 
MVEX1 
MVEX2 
MVEX3 
OPCODE 
ModR/M 


{IM M8} 


0 1 


1 0 0 0 


7 6 


D 4 3 Z 


1713 'Z2Q4 1723 IZ14 m3, mg, my mo 
7 6 5 4 


Operand is a memory location 


ESCAPE(62) 
MVEX1 
MVEX2 
MVEX3 
OPCODE 
ModR/M 
{SIB} 


{DISPL} 


3 
W 1 1 1 1 | L=0 | pi Po 
7 6 5 q 3 z T 0 
EH So Sy So 1 | klg Kil, Kilo 
7 6 5 a 3 Z T U 
OPCODE 
7 6 5 4 3 2 T 0 
11 reg (ZMM1) r (ZMM2) 

6 5 a 3 Z T 0 
Ty Ig Ts I, T3 Ig I, Io 
7 6 5 a 3 2 T 0 
0 1 1 0 0 0 L 0 
7 6 5 a 3 Z T 0 
AE 1X IB IZ14 m3, mga my mo 
7 6 5 4 3 2 T 0 
WwW 1 1 1 1 | L=0 | pi Po 
7 6 5 7 3 z T 0 
EH So Sy So 1 | Kklg Kil, Klo 
7 6 5 a 3 Z T 0 
OPCODE 
7 6 5 4 3 z I U 
mod reg (ZMM1) m (mt) 
7 6 5 a 3 z T 0 
SIB byte 
7 6 5 a 3 2 T 0 
Displacement (8*N/32) 
31,8 E A é 7 0 
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VectorVector v6 
Opcode Instruction Description 
MVEX.512 VOP zmm1 {k1}, S(mv;) Gather sparse vector S(mv;) into zmm1, using 
completion mask k1 
MVEX.512 VOP mv; {k1}, D(zmm1) Scatter vector D(zmm1) into sparse vector 
mu, using completion mask k1 
Description 


Operand is a memory location 


ESCAPE(62) 0 1 1 0 0 0 1 0 
7 6 5 q 3 z iy 
MVEX1 IZ 13 1X3 'Bs 'Z14 m3 mg My Mo 
7 6 5 1 3 z U 
MVEX2 W 1 i 1 1 L=0 | pi Po 
if 6 5 4 3 z U 
MVEX3 EH Sy Sy So | 1X4] Kle K1li Ko 
7 6 5 q 3 z iy 
OPCODE OPCODE 
7 6 5 z 3 z 0 
ModR/M mod reg (ZMM1) m= 100 
7 6 5 4 3 z U 
VSIB SS; SSo Index(X) Base(B) 
7 6 5 q 3 Z 
{DISPL} Displacement (8*N/32) 
31,8 : : 
{IM M8} Iz Ig Ts I4 Iz Ig I; Io 


7 6 5 ay 3 2 T 0) 
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VectorVector v7 
Opcode Instruction Description 
MVEX.512 VOP zmm1 {k1}, k2, S(zmm3/m,) Operate mask k2 and vector S(zmm3/m,) [and 
vector zmm1], and store the result in zmm1, un- 
der write-mask k1 
Description 


Operand is a register 


ESCAPE(62) 0 1 1 0 0 0 1 0 

7 6 5 q 3 z y 
MVEX1 IZ 1s 1734 1733 IZ14 m3 ms, my, mo 

7 6 5 a 3 z 0 
MVEX2 W 1 'K2. 'K2) !K29 | L=0 | pi Po 

7 6 5 q 3 z iy 
MVEX3 EH So Sy So 1 K1lg Kili Ko 

7 6 5 a 3 z 0 
OPCODE OPCODE 

7 6 5 4 3 z U 
ModR/M 11 reg (ZMM1) r (ZMM3) 

7 6 5 q 3 z iy 
Operand is a memory location 
ESCAPE(62) 0 1 1 0 0 0 1 0 

7 6 5 a 3 z 0 
MVEX1 VAR 1X IB IZ14 m3, mg my mo 

7 6 5 7 3 z iy 
MVEX2 W 1 '"K2Q. 12, 129 | L=0 ] py Po 

7 6 5 4 3 z U 
MVEX3 EH So Sy So 1 K1lg Kl, Ko 

7 6 5 q 3 z iy 
OPCODE OPCODE 

7 6 5 a 3 z U 
ModR/M mod reg (ZMM1) m (mt) 

7 6 5 4 3 z U 
{SIB} SIB byte 

7 6 5 q 3 z y 
{DISPL} Displacement (8*N/32) 

3L8 0 
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VectorVector v8 
Opcode Instruction Description 
MVEX.512 VOP zmm1 {k1}, zmm2,zmm3/m; Operate vector zmm2 and vector zmm3/m; 
[and vector zmm1] and store the result in 
zmm1, under write-mask k1 
MVEX.512 VOP zmm1i1 _ {ki}, zmm2, Operate vector zmm2 and vector zmm3/m; 
zmm3/mz, imm8 [and vector zmm1] and store the result in 
zmm1 using imm8, under write-mask k1 
Description 
Operand is a register 
ESCAPE(62) 0 1 1 0 0 0 1 0 
7 6 5 q 3 z U 
MVEX1 IZ 13 1734 1733 IZ14 m3 m2 my mo 
7 6 5 4 3 z U 
MVEX2 W | !Z23  !Z2. !Z2, !Z29 | L=0 | pi Po 
7 6 5 q 3 z y 
MVEX3 EH 0 0 0 172, | Klg K1, Kg 
7 6 5 z 3 z U 
OPCODE OPCODE 
7 6 5 4 3 z y 
ModR/M 11 reg (ZMM1) r (ZMM3) 
7 5 q 3 U 
{IM M8} Ty Ig Ts I T3 Ig I, Io 
7 6 5 4 3 z 1 
Operand is a memory location 
ESCAPE(62) 0 dl 1 0 0 0 1 0 
7 6 5 a 3 Z U 
MVEX1 IZ13 1X IB IZ14 m3, mga My mo 
7 6 5 a 3 2 0 
MVEX2 W | !Z23  !Z2. !Z2, !Z29 | L=0 | pi Po 
7 6 5 7 3 2 y 
MVEX3 EH 0 0 0 172, | Klp K1, Kg 
7 6 5 q 3 z U 
OPCODE OPCODE 
7 6 5 4 3 z U 
ModR/M mod reg (ZMM1) m (mt) 
7 6 5 a 3 z U 
{SIB} SIB byte 
7 6 5 4 3 z U 
{DISPL} Displacement (8*N/32) 
318 y 
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APPENDIX F. GENERAL TEMPLATES 
Vector v9 - Template 


VectorVector v9 
Opcode Instruction Description 
MVEX.512 VOP S(mv;) {k1} Prefetch sparse vector S(mv;), under write- 

mask k1 

Description 

Operand is a memory location 
ESCAPE(62) 0 1 1 0 0 1 0 
7 6 5 4 3 2 U 
MVEX1 1 1X3 'Bs 1 m3 mg my mo 
7 6 5 q 3 z 0 
MVEX2 W 1 1 1 1 L=0 | pr Po 
7 6 5 z 3 z U 
MVEX3 EH Sp SS, So | !X4 |} Klg Kl, Kilo 
7 6 5 4 3 2 U 
OPCODE OPCODE 
is 6 5 x 3 z 0 
ModR/M mod Op. Ext. m= 100 
7 6 5 a 3 Z 0 
VSIB SS; SSo Index(X) Base(B) 
7 6 5 4 3 z 
{DISPL} Displacement (8*N/32) 


722 Reference Number: 327364-001 


APPENDIX F. GENERAL TEMPLATES 


F.3 Scalar Operation Templates 


Reference Number: 327364-001 723 


APPENDIX F. GENERAL TEMPLATES 


> 
D 


Scalar sO - Template 


scalarScalar sO 


Opcode Instruction Description 

OF/0F38/0F3A OP r16, r16/m16 Operate [r16 and] r16/m16, leaving the result 
in r16 

OF/0F38/0F3A OP r32, r32/m32 Operate [r32 and] r32/m32, leaving the result 
in r32 

REX.W OF/0F38/0F3A OP r64, r64/m64 Operate [r64 and] r64/m64, leaving the result 
in r64 

Description 


Operand is a register 


C4 Version 
ESCAPE(C4) 1 1 0 0 0 1 0 0 
7 6 5 a 3 z T U 
VEX1 ldstz 1 '!srceg | m4 m3 mg my mo 
7 6 5 q 3 z T 0 
VEX2 W 1 1 1 1 | L=0 | py po 
7 6 5 Z 3 Z T U 
OPCODE OPCODE 
7 6 5 q 3 z T 0 
ModR/M 11 reg (dst) r (src) 
7 6 5 q 3 z T U 
C5 Version 
ESCAPE(C5) 1 1 0 0 0 1 0 1 
7 6 5 q 3 z T 
VEX2 ldstz | 1 1 1 1 | L=0 | py po 
7 6 5 Z 3 Z T U 
OPCODE OPCODE 
7 6 5 a 3 z T 0 
ModR/M 11 reg (dst) r (src) 
7 6 5 q T U 
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scalarScalar s1 


Opcode Instruction Description 
VEX.128 OP m: Prefetch/Evict m; memory location 
Description 


Operand is a memory location 


C4 Version 
ESCAPE(C4) | 1 iL 0 0 0 1 0 0 

7 6 5 a 3 Z T y 
VEX1 1 IX !B me M3 My. M, Mo 

7 6 5 a 3 2 I 0 
VEX2 wii 1 1 1 | L=0}] pi po 

7 6 5 q 3 z T 0 
OPCODE OPCODE 

7 6 5 a 3 Z T U 
ModR/M mod Op. Ext m (mt) 

T 6 5 4 3 2 T 0 
{SIB} SIB byte 

7 6 5 7 3 z T y 
{DISPL} Displacement (8/32) 

31,8 ; : ; , U 

C5 Version 
ESCAPE(CS5) | 1 1 0 0 0 1 0 1 

7 6 5 z 3 Z T 
VEX2 1 1 1 di 1 | L=0 |] py po 

7 6 5 a 3 z T 0 
OPCODE OPCODE 

7 6 5 q 3 z T 1 
ModR/M mod Op. Ext. m (mt) 

7 6 5 a 3 z T y 
{SIB} SIB byte 

7 6 5 4 3 2 I 0 
{DISPL} Displacement (8/32) 

31,8 : ; 


Reference Number: 327364-001 


725 


